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A  multiple  objective  mathematical  programming  (MOMP)  problem  involves 
simultaneously  maximizing  or  minimizing  several  noncomparable  objective  functions  over 
a  nonempty  feasible  region.  In  order  to  help  the  decision  maker  find  a  most  preferred 
solution  to  the  underlying  problem,  researchers  have  shown  that  one  can  generally  restrict 
one's  attention  to  the  subset  of  feasible  solutions  called  the  efficient  set.  One  important  and 
new  (compared  to  traditional  single  objective  mathematical  programming)  research  area  in 
muhiple  objective  mathematical  programming  is  to  investigate  the  characteristics, 
properties  and  structure  of  the  efficient  set  and  the  weakly  efficient  set.  The  characteristics 
and  properties  of  the  efficient  set  not  only  have  important  theoretical  meamng  but  also 
provide  the  theoretical  foundations  upon  which  various  algorithms  are  based.  Another 


important  research  area  is  to  develop  algorithms  that  can  be  used  to  solve  large-scale 
multiple  mathematical  programming  problems  efficiently. 

In  this  dissertation,  we  first  investigate  the  necessary  and  sufficient  conditions  for 
the  efficient  set  of  the  problem  (MOMP)  to  be  closed.  There  are  various  theoretical, 
algorithmic,  and  practical  reasons  for  investigating  the  necessary  and  sufficient  conditions 
for  the  efficient  set  of  the  problem  (MOMP)  to  be  closed.  However,  only  a  small  number 
of  resuhs  of  this  type,  limited  to  some  special  cases,  have  been  developed.  In  this  research, 
we  present  a  necessary  condition  and  several  sufficient  conditions  for  the  efficient  set  of  a 
general  MOMP  problem  to  be  closed.  Our  approach  relies  in  part  upon  generalizing  the 
concepts  of  quasi-concavity  and  strict  quasi-concavity  for  real-valued  functions  to  vector- 
valued  functions.  Our  approach  also  relies  upon  some  new  characterizations  of  efficient 
solutions  of  problem  (MOMP)  that  we  developed  in  this  research. 

The  remainder  of  this  research  is  focused  on  developing  new  outcome  space-based 
algorithms  for  potentially  solving  large-scale  multiple  objective  linear  programming 
(MOLP)  problems.  In  this  dissertation,  two  new  outcome  space-based  weight  set 
decomposition  algorithms  have  been  developed  for  solving  the  problem  (MOLP)  by  using 
the  vector  maximization  approach.  One  algorithm  is  devoted  to  finding  the  set  of  all 
efficient  extreme  points  in  the  outcome  space  for  problem  MOLP.  The  other  algorithm  is 
devoted  to  finding  the  entire  efficient  outcome  set  of  problem  MOLP.  To  our  knowledge, 
this  algorithm  is  the  first  one  capable  of  generating  the  entire  efficient  outcome  set  of  a 
multiple  objective  linear  programming  problem  directly.  Both  algorithms  are  based  in  part 
upon  our  new  partition  of  the  weight  set.  These  two  algorithms  overcome  the  difficulties 


VI 


that  face  the  traditional  decision  space  based  weight  set  decomposition  algorithms.  They 
may  prove  to  be  capable  of  solving  large-scale  (MOLP)  problems  efficiently. 
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,'    "    CHAPTER  1 
INTRODUCTION 


Decision  making  is  the  process  of  selecting  a  possible  course  of  action  from  all  of 
the  available  alternatives.  In  such  processes,  the  decision  maker  or  decision  makers  want 
to  attain  one  or  more  than  one  objective  or  goal  in  selecting  a  preferred  course  of  action 
while  satisfying  the  constraints  dictated  by  the  environment.  In  the  real  world,  many 
decision  making  processes  involve  a  single  decision  maker  (DM)  who  chooses  among  a 
countable  or  an  uncoumable  set  of  alternatives  by  using  two  or  more  criteria.     These 
processes  are  called  multiple  criteria  decision  making  (MCDM)  processes.  When  the 
values  of  the  criteria  are  assumed  to  be  known  with  certainty,  the  MCDM  problem  is 
called  deterministic,  otherwise  it  is  called  non-determimstic  (or  stochastic).  Throughout 
this  dissertation,  we  will  limit  our  discussion  to  deterministic  MCDM  problems. 

1.1.  Historical  Perspective  on  MCDM 

In  this  subsection,  we  will  give  a  brief  historical  perspective  on  the  development  of 
MCDM.  We  will  confine  our  discussion  of  solution  techniques  to  the  mathematical 
programming  approaches.  Our  review  is  largely  based  upon  the  perspective  required  for 
understanding  the  chapters  to  follow.  For  deeper  background  and  additional  references  in 
the  field,  the  reader  is  referred  to  the  books  and  survey  papers  by  Cohon  (1978),  Stadler 


(1979),  Hwang  and  Masud  (1979),  Zeleny  (1982),  Chankong  and  Haimes  (1983),  Evans 
(1984),  Sawaragi  etal.  (1985),  Yu  (1985),  Gal  (1986),  Steuer  (1986),  Shin  and  Ravindran 
(1991),  Dyer  et  al.  (1992),  Korhonen  et  al.  (1992),  Pardalos  et  al.  (1995),  and  references 

therein. 

Mathematically,  one  way  to  represent  a  multiple  criteria  decision  making  (MCDM) 
problem  is  by  modeling  it  as  a  multiple  objective  mathematical  programmmg  problem.  A 
multiple  objective  mathematical  programming  problem  may  be  written 
MOMP:  v-max  f(x)  =  (fi(x),  . . .  ,  fp(x))   , 

s.t.  x  eX, 
where  x  eR"  is  a  vector  of  decision  variables,  f; ,  i  =  l,2,...,p,  are  objective  functions  and 
X  is  the  set  of  feasible  decision  alternatives. 

X  is  usually  called  the  decision  set  of  problem  MOMP.  Let 
Y={yeR''|y  =  flx),xeX}. 

Y  is  usually  called  the  outcome  set  of  problem  MOMP. 

When  f(x)  is  a  linear  vector-valued  function  and  X  is  a  convex  polyhedron,  the 
problem  MOMP  is  called  a  linear  vector  maximization  problem  or  a  multiple  objective 
linear  programming  (MOLP)  problem.  ..     .^ 

In  problem  MOMP,  the  goal  is  to  simultaneously  maximize  all  of  the  objective 
functions  However,  with  rare  exceptions,  the  objective  functions  of  problem  MOMP 
conflict  with  one  another.  As  a  result,  a  solution  that  simultaneously  maximizes  all  of  the 
objective  functions  exists  only  in  rare  cases.  Therefore,  instead  of  trying  to  find  a  solution 
that  maximizes  all  of  the  objective  functions  simultaneously,  researchers  and  practitioners 
generally  try  to  find  a  solution  that  maximizes  the  DM's  preferences.  In  other  words. 


"solving"  problem  MOMP  means  finding  a  most  preferred  solution  of  the  DM.  In  order  to 
find  such  a  solution,  some  information  about  the  DM's  preference  structure  is  required. 
The  most  complete  way  of  expressing  this  information  is  by  finding  the  DM's  utility 
function,  also  called  a  value  function,  over  the  objective  fiinction  space  of  the  problem 
(see  e.g.  Keeney  and  Raiflfa,  1976). 

Definition  1.1.1.  A  fiinction  u,  which  associates  a  real  number  u(f(x))  to  each  x  in 
X,  is  said  to  be  a  utility  function  representing  a  particular  decision  maker's  preference 

structure  provided  that 

(1)  f(x')  ~  fl^x')  if  and  only  if  u(f(x^))  -  u(f(x'))  for  all  x',  x'  in  X;  and 

(2)  f(x  V  f(x')  if  and  only  if  u(f(x'))  >  u(f(x'))  for  all  x',  x'  in  X, 

where  f(x')  ~  f(x^)  denotes  that  the  decision  maker  is  indifferent  between  outcomes  f(x') 
and  f(x^),  and  f((x')>-  f(x^)  denotes  that  the  decision  maker  prefers  f(x^)  to  f(x^). 

Given  a  utility  fiinction  u  for  the  DM,  the  decision  maker's  most  preferred  solution 
is  one  that  maximizes  u  over  all  feasible  solutions;  such  a  solution  is  also  called  a  best 
compromise  solution  (in  the  sense  that  it  is  typically  a  compromise  among  the  problem's 
various  objective  fiinctions).  Under  the  assumption  that  more  of  each  objective  fiinction  is 
preferred  to  less,  a  best  compromise  solution  must  also  be  an  efficient  solution,  where  an 
efficient  solution  is  defined  as  follows. 

Definition  1.1.2.  A  point  x^gR"  is  called  an  efficient  solution  (or  a  nondominated 
solution)  of  MOMP  if  x"  gX  and  there  is  no  x  gX  such  that  fl^x)  >  fi^x")  and  f(x)  ^  fi^x°). 

The  set  of  all  efficient  solutions  of  problem  MOMP  is  usually  called  the  efficient 
decision  set  of  problem  MOMP  If  x°  is  an  efficient  solution  of  problem  MOMP,  then  y°  = 
f(x°)  is  usually  called  an  efficient  outcome  of  problem  MOMP.  The  set  of  all  efficient 
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outcomes  of  problem  MOMP  is  called  the  efficient  outcome  set  of  problem  MOMP  We 
will  refer  to  both  the  efficient  decision  set  and  the  efficient  outcome  set  as  the  efficient  set 
when  the  results  apply  to  both  sets.        ,,,    -'' 

Closely  related  to  the  concept  of  an  efficient  solution  is  the  concept  of  a  weakly 
efficient  solution.  A  weakly  efficient  solution  may  be  defined  as  follows.  '-  ■: ..  '  '* 

Definition  1.1.3.   A  point  x°gR"  is  called  a  weakly  efficient  solution  (or  a  weakly 
nondominated  solution)  of  MOMP  if  x°  gX  and  there  is  no  x  eX  such  that  f(x)  >  f(x°). 

Similarly,  we  have  the  concepts  of  weakly  efficient  outcome,  weakly  efficient 
decision  set,  weakly  efficient  outcome  set  and  weakly  efficient  set.  *    i  _ 

The  concept  of  efficiency  has  played  a  usefiil  role  in  analyzing  problem  MOMP.  In 
particular,  it  has  been  found  to  be  very  useful  in  maximizing  the  decision  maker's  utility 
fiinction  over  X  when  the  form  of  u  is  unknown.  The  notion  of  an  efficient  solution  was 
first  introduced  by  Pareto  in  1896  (see  Pareto,  1896).  However,  until  the  1950's  when 
Koopmans  (1951)  introduced  the  concept  of  an  efficient  vector,  very  few  researchers  were 
involved  in  the  field  of  MCDM.  An  early  formulation  of  the  problem  of  vector 
maximization  was  due  to  Kuhn  and  Tucker  (1951)  and  later  to  Karlin  (1962).  A  direct 
extension  of  Koopmans'  ideas  also  appears  in  a  book  by  Charnes  and  Cooper  (1961). 

In  order  to  exclude  certain  efficient  solutions  that  display  an  undesirable  anomaly, 
several  authors  have  developed  several  more  sophisticated  concepts  of  efficiency.  Kuhn 
and  Tucker  (1951)  were  the  first  to  propose  a  special  concept  of  efficiency  which  they 
called  proper  efficiency.  Geoffrion  (1968)  later  refined  Kuhn  and  Tucker's  definition.  The 
underlying  domination  cone  utilized  in  both  of  these  definitions  was  the  ordinary 
nonpositive  orthant.  In  1974,  Yu  (1974)  introduced  a  domination  structure  defined  by  a 


generalized  convex  cone.  Soon  after,  Borwein  (1977)  proposed  a  definition  of  proper 
efficiency  for  the  case  when  the  domination  cone  is  any  nontrivial,  closed  convex  cone. 
Benson  (1979)  and  Henig  (1982)  later  refined  Borwein's  definition.  In  a  related  vein,  Hu 
(1990)  subsequently  introduced  the  concept  of  major  efficiency  when  the  domination 
structure  is  defined  by  a  certain  nonconvex  cone.  ;    ■ 

Much  of  the  research  in  MCDM  has  occurred  since  1970.  In  fact,  Zeleny  (1982) 
notes  that  the  general  area  of  multiple  criteria  decision  making  was  the  most  rapidly 
growing  area  of  operations  research  during  the  1970's.  Most  of  the  MCDM  research  in 
the  1970's  was  focused  on  the  theoretical  foundations  of  muUiple  objective  mathematical 
programming  and  the  development  of  algorithms  and  procedures  for  solving  some  of  these 
problems  -  especially  muUiple  objective  linear  programming  problems  and  problems  with 

discrete  alternatives.  «.',V 

Since  a  best  compromise  solution  must  be  an  efficient  solution  under  mild 
assumptions  usually  satisfied  in  practice,  one  approach  to  solving  MOMP  is  to  find  all  or  a 
part  of  the  efficient  set  and  present  them  to  the  DM  for  evaluation.  This  kind  of  approach 
is  usually  referred  to  as  the  vector  maximization  approach.  During  the  1970s,  most 
researchers  focused  on  developing  and  investigating  algorithms  that  use  this  approach.  As 
a  result,  many  algorithms  for  determining  the  set  of  all  efficient  extreme  points  or  the 
entire  efficient  decision  set  of  a  muUiple  objective  linear  program  were  developed  in  this 
period.  We  will  give  a  literature  review  of  the  algorithms  that  use  the  vector  maximization 
approach  for  solving  multiple  objective  linear  programming  problems  in  Section  2.3.  The 
reader  is  also  referred  to  the  review  paper  by  Evans  (1984)  and  to  the  book  by  Steuer 


(1986)  for  deeper  reviews  of  the  algorithms  that  were  developed  during  this  period  for 
multiple  objective  linear  programming. 

One  important  and  new  (compared  to  traditional  single  objective  mathematical 
programming)  research  area  in  multiple  objective  mathematical  programming  is  to 
investigate  the  characteristics,  properties  and  structure  of  the  efficient  set  and  the  weakly 
efficient  set.  The  characteristics  and  properties  of  the  efficient  set  not  only  have  important 
theoretical  meaning  but  also  provide  the  theoretical  foundations  upon  which  various 
algorithms  are  based.  For  example,  many  algorithms  are  based  upon  the  theoretical  fact 
that  an  efficient  solution  can  be  characterized  as  an  optimal  solution  to  an  appropriate 
single  objective  mathematical  programming  problem.   In  addition,  the  simplex-based 
methods  for  finding  the  entire  efficient  decision  set  of  a  multiple  objective  linear 
programming  problem,  for  example,  are  usually  based  in  part  upon  two  theoretical  facts. 
The  first  of  these  is  the  fact  that  the  efficient  decision  set  for  such  a  problem  is  the  union 
of  its  efficient  faces.  The  second  is  the  fact  that  the  set  of  all  efficient  extreme  points  for 
such  a  problem  is  connected  in  the  sense  that  one  can  move  fi-om  one  extreme  point  to  any 
other  without  having  to  leave  the  edges  of  the  efficient  decision  set  (Yu  and  Zeleny, 
1975).  For  details  of  various  simplex-based  algorithms  for  finding  the  entire  efficient 
decision  set  of  problem  MOLP,  the  reader  is  referred  to  Steuer  (1986). 

During  the  1970's,  research  on  the  characteristics,  properties  and  structure  of  the 
efficient  set  and  of  the  weakly  efficient  set  was  focused  on  developing  various  kinds  of 
approaches  for  characterizing  efficient  solutions  and  weakly  efficient  solutions  of  problem 
MOMP.  We  will  give  a  more  detailed  review  of  the  characteristics,  properties  and 


structure  of  the  efficient  set  of  problem  MOMP  in  Sections  2.1-2.2.  The  reader  is  also 
referred  to  the  review  paper  by  Gal  (1986).       >  ■ 

Duality  and  stability  theories  were  also  substantially  investigated  by  many  authors 
during  the  1970s.  The  reader  is  referred  to  the  book  by  Sawaragi  et  al.  (1985)  and  to  the 
review  paper  by  Gal  (1986)  for  details. 

During  the  1980's,  emphasis  shifted  toward  the  implementation  of  MCDM  models 
and  algorithms  on  computers.  Decision  support  systems  were  developed  to  aid  this 
implementation. 

With  respect  to  the  development  of  new  algorithms,  in  part  since  the  size  of  the 
efficient  set  can  make  it  difficult  to  find  a  final  best  compromise  solution,  interactive 
procedures  moved  to  center  stage  in  the  1980s.  This  class  of  procedures  rehes  on  the 
progressive  definition  of  the  DM's  preferences  along  with  the  exploration  of  the  criterion 
space.  The  progressive  definition  takes  place  through  a  DM-analyst  or  DM-machine 
dialogue  at  each  iteration. 

A  typical  interactive  algorithm  can  be  characterized  by  the  following  procedure: 
(1)  find  a  solution  (preferably  feasible  and  efficient);  (2)  interact  with  the  DM  to  obtain 
his/her  reaction/response  to  this  solution,  and  (3)  repeat  the  above  steps  until  the  current 
solution  is  "close  enough"  to  a  best  compromise  solution  or  until  some  other  termination 
criterion  is  met.  For  details  about  the  research  of  this  type  in  this  period,  see  the  review 
papers  by  Korhonen  et  al.  (1992)  and  Shin  and  Ravindran  (1991)  and  the  references 
therein. 

As  we  mentioned  earlier,  one  important  topic  in  multiple  objective  programming  is 
the  investigation  of  the  characteristics  and  properties  of  the  efficient  set.  During  the  1980s, 


research  in  this  topic  was  focused  on  investigating  the  connectedness  of  the  efficient  set 
and  of  the  weakly  efficient  set.  The  connectedness  of  the  weakly  efficient  set  of  problem 
MOMP  was  first  studied  by  Warburton  (1983).  For  further  results  on  the  connectedness 
of  the  weakly  efficient  set,  the  reader  is  referred  to  Luc  (1989).  For  the  connectedness  of 
the  efficient  set,  one  open  problem  raised  in  this  period  was  whether  or  not  the  efficient  set 
of  an  m-dimensional  MOMP  problem  is  connected  when  all  objective  functions  are 
continuous  and  strictly  quasiconcave,  and  the  decision  set  is  compact  and  convex.  Schaible 
(1983)  solved  the  problem  in  the  case  of  two  objective  functions,  and  then  Choo  et  al. 
(1985)  obtained  a  partial  solution  in  the  case  of  three  objective  functions.  Finally, 
Daniilidis,  Hadjidis  and  Schaible  (1997)  completely  solved  the  problem  in  the  case  of  three 
objective  fiinctions.  For  higher  dimensions,  Hu  and  Sun  (1993)  solved  the  problem  in  the 
case  where  the  efficient  set  is  closed.  Subsequemly,  Sun  (1996)  solved  the  problem  in  the 
case  where  one  objective  function  is  strongly  quasiconcave.  Finally,  Benoist  (1998) 
extended  the  results  of  Sun  ( 1 996)  and  solved  the  problem. 

Since  the  late  1980s,  MCDM  research  has  increasingly  focused  on  how  to  support 
the  real  world  decision  making  process.  Traditionally,  any  problem  in  operations  research 
is  divided  into  two  phases,  formulation  and  solution.  However,  this  scheme  is  improper  in 
the  real  world.  It  is  not  fully  realistic  to  assume  that  a  DM  is  able  to  formulate  a  problem 
precisely  prior  to  its  solution.  For  the  majority  of  decision  making  problems,  the  actual 
process  is  a  multiply-repeated,  cyclic  process  of  "formulation-solution-analysis-correction- 
...."  (see  Statnikov  and  Matusov,  1995).  As  a  result,  in  recent  years,  much  MCDM 
research  has  focused  on  developing  systems  that  support  the  entire  decision  making 


process   from  problem   structuring   through   solution   and   implementation   (see,    e.g. 


Korhonen  and  Wallenius,  1988). 

■■"■**:■" 


1.2.  Motivation  for  this  Research 


The  real  world  challenges  us  with  many  large-scale  multiple  criteria  decision 
making  problems.  It  is  known  that  the  efficient  decision  set  of  problem  MOMP  is  generally 
a  complicated  nonconvex  set  and  grows  rapidly  as  the  size  of  the  problem  increases  (see 
e.g.  Benson,  1998a).  As  a  result,  even  with  the  aid  of  recent  decision  support  systems,  the 
algorithms  that  find  all  or  a  substantial  part  of  the  efficient  decision  set  for  problem 
(MOMP)  in  the  decision  space  are  usually  not  able  to  usefully  solve  large-scale  problems. 

For  example,  consider  some  results  reported  by  Benson.  In  Benson  (1998a),  the 
ADBASE  algorithm  of  Steuer  (1989)  was  used  to  find  the  set  of  all  efficient  extreme 
points  in  the  decision  space  of  some  randomly-generated  multiple  objective  linear 
programming  problems  with  four  objective  fiinctions.  Benson  found  that  when  n=30  and 
X  is  described  by  25  linear  inequalities,  the  average  number  of  efficient  extreme  points  in 
X  in  a  set  often  randomly-generated  problems  was  7245.90.  When  n  was  increased  to  50 
and  X  was  described  by  50  linear  inequalities,  this  average  jumped  to  83,780.60  points. 
With  n=60  and  with  50  linear  inequalities  describing  X,  each  of  the  ten  problems  that  were 
randomly-generated  in  this  study  exceeded  the  solution  capacity  of  ADBASE,  indicating 
that  the  number  of  efficient  extreme  points  in  the  decision  space  in  each  of  these  problems 
exceeded  200,000.  These  results  indicate  that,  for  a  large-scale  MCDM  problem,  we 
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either  cannot  generate  all  or  a  substantial  part  of  the  efficient  decision  set,  or  the  generated 
set  will  probably  overwhelm  the  DM. 

It  is  largely  because  of  this  that  interactive  procedures  became  popular  in  the 
1980's.  The  interactive  approach  is  actually  a  learning  process.  The  DM,  in  fact,  takes  part 
in  the  solution  process  of  an  interactive  procedure.  Because  of  these  and  other  advantages, 
it  seems  reasonable  to  think  that  interactive  approaches  would  be  very  useful  in  practice. 
However,  Korhonen  et  al.  (1992)  pointed  out  that,  in  actuality,  only  a  handful  of 
interactive  multiple  objective  procedures  have  been  applied  and  implemented  in  practice. 

One  problem  with  interactive  approaches  is  that  nearly  all  of  them  require 
consistent  responses  from  the  DM  to  be  successful.  For  large-scale  problems,  it  may 
becomes  very  difficult  for  the  DM  to  respond  consistently.  This  is  because,  for  a  large- 
scale  problem,  it  may  take  numerous  iterations  to  finally  reach  a  solution  that  satisfies  the 
DM.  Furthermore,  each  iteration  may  take  much  more  time  for  a  large-scale  problem  than 
for  a  small-scale  problem.  Thus,  the  assumption  that  the  DM  can  provide  consistent 
responses  usually  draws  severe  criticism.  Some  researchers,  such  as  French  (1984),  feel 
that  the  value  of  the  interactive  methods  is  significantly  diminished  due  to  this  drawback. 

Another  problem  with  the  interactive  approach  is  that  only  a  few  points  in  the 
feasible  set  or  the  efficient  set  are  generally  explored.  This  is  in  part  because  the  learning 
process  is  tedious  and  the  DM  tends  to  get  tired  after  a  relatively  small  number  of 
interactions.  As  a  result,  the  DM  may  not  be  provided  with  sufficient  information  about 
the  efficient  set  to  make  a  useful  choice  of  a  best  compromise  solution  For  large-scale 
problems,  this  situation  may  become  worse  because  of  the  larger  size  of  the  efficient  set. 


11 


The  discussions  above  show  that  it  is  still  very  important  to  develop  effective 
algorithms  that  can  solve  large-scale  problems.  Some  ideas  and  algorithms  have  been 
proposed,  in  particular,  for  potentially  solving  large-scale  multiple  objective  linear 
programming  problems  by  the  vector  maximization  approach. 

One  of  these  ideas  involves  analyzing  multiple  objective  linear  programming 
problems  in  the  outcome  space  (see  e.g.  Dauer,  1987,  Benson,  1995a).  Three  reasons  for 
analyzing  multiple  objective  linear  programming  problems  in  the  outcome  space,  rather 
than  in  the  decision  space,  were  summarized  in  Benson  (1998c). 

First,  the  dimension  p  of  the  outcome  space  is  typically  much  smaller  than  the 
dimension  n  of  the  decision  space.  As  a  result,  the  efficient  outcome  set  is  invariably  much 
smaller  and  has  a  much  simpler  structure  than  the  efficient  decision  set,  see,  e.g.  Benson 
(1995a,  1997,  1998a-c),  Dauer  (1987,  1993),  Dauer  and  Saleh  (1990,  1992)  and  Dauer 
and  Liu  (1990).  Generating  all  or  parts  of  the  efficient  outcome  set  is  therefore  expected, 
in  general,  to  be  less  computationally  demanding  than  generating  all  or  portions  of  the 
efficient  decision  set.  Furthermore,  it  also  follows  that  the  DM  will  be  less  likely  to  be 
confused  or  overwhelmed  if  all  or  portions  of  the  efficient  outcome  set  are  presented  to 
him  or  her  than  if  all  or  portions  of  the  efficient  decision  set  are  presented.  "  . . 

Second,  the  DM  generally  prefers  searching  for  a  most  preferred  solution  by 
examining  the  efficient  outcome  set  rather  than  the  efficient  decision  set.  This  has  been      : 
shown  by  empirical  research. 

Third,  it  is  well  known  that  frequently  the  objective  functions  map  many  points  in 
the  efficient  decision  set  onto  either  a  single  outcome  or  onto  essentially-equivalent 
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outcomes  in  the  efficient  outcome  set.  Thus,  generating  points  directly  from  the  efficient 
outcome  set  avoids  risking  redundant  calculations  of  points  in  the  efficient  decision  set. 

To  our  knowledge,  the  first  algorithm  capable  of  generating  the  set  of  all  efficient 
extreme  points  in  the  outcome  space  for  general  multiple  objective  linear  programming 
problems  was  proposed  by  Benson  (1998a).  This  algorithm  uses  outer  approximation 
techniques  from  global  optimization  (Horst  and  Tuy,  1993).  It  works  by  generating  a  finite 
number  of  polyhedra  that  each  approximates  an  "efficiency-equivalent"  polyhedron  for  the 
problem.  The  algorithm  is  finite,  works  in  the  outcome  space,  and  can  be  implemented 
relatively  easily  by  using  univariate  search  techniques,  linear  programming,  and  some 
global  optimization  techniques.  The  most  computationally-demanding  task  in  the 
algorithm  calls  for  determining  the  set  of  extreme  points  of  each  new  polyhedron  that  is 
created  by  adding  a  linear  inequality  cut  at  each  step  of  the  algorithm.  This  is 
accomplished  with  the  aid  of  outer  approximation.  As  a  by-product  of  the  algorithm,  the 
entire  weakly  efficient  outcome  set  of  problem  MOLP  is  also  generated  (see  Benson, 

1998a,  1998c). 

A  newer  outcome  space-based  method  for  multiple  objective  linear  programming, 
called  a  hybrid  approach,  has  also  been  proposed  by  Benson  (1998c).  This  approach 
adapts  two  global  optimization,  decision  set-based  methods  to  outcome  space.  These 
methods  are  a  special  simplicial  partitioning  technique  of  Ban  (see  Ban,  1983;  Tuy  and 
Horst,  1988),  proposed  originally  for  solving  concave  minimization  problems,  and  a 
general  outer  approximation  method  that  has  been  used  very  frequently  to  help  solve  a 
variety  of  global  optimization  problems  (see  Horst  and  Tuy,  1993  and  Horst  and  Pardalos, 
1995).  In  particular,  the  simplicial  partitioning  technique  is  systematically  integrated  into 
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the  outer  approximation  scheme  in  outcome  space  to  determine  all  efficient  extreme  points 
in  the  outcome  set  of  the  problem  in  a  finite  number  of  iterations. 

The  two  algorithms  of  Benson  have  many  potential  advantages  (see  Benson, 
1998a,  1998c).  Because  of  their  advantages,  these  two  algorithms  may  prove  to  be 
suitable  for  solving  large-scale  multiple  objective  linear  programming  problems. 

However,  since  the  two  algorithms  of  Benson,  to  our  knowledge,  are  the  only  two 
outcome  space  based  algorithms  that  are  capable  of  generating  the  set  of  all  efficient 
extreme  points  of  a  general  MOLP  problem,  and  since  we  don't  know  how  well  these  two 
algorithms  will  work,  we  need  to  develop  and  explore  more  new  outcome  space  based 
algorithms.  In  particular,  because  different  kinds  of  problems  may  need  different 
approaches,  the  algorithms  of  Benson  (1998a,  1998c)  may  work  well  on  some  problems 
but  not  on  others.  As  a  result,  we  may  need  alternative  algorithms  for  efficiently  finding 
the  efficient  outcome  set  of  problem  MOLP  in  some  cases.  This  also  calls  for  more 
outcome  space  based  algorithms  for  generating  the  set  of  efficient  extreme  points  of 
problem  MOLP. 

The  rationale  for  generating  the  set  of  all  efficient  extreme  points  is  based  on  the 
assumption  that  the  best  efficient  extreme  point  is  an  acceptable  approximation  of  a  best 
compromise  solution.  However,  this  assumption  may  not  true.  As  a  result,  we  may  need  to 
generate  the  entire  efficient  set  in  some  cases.  The  algorithms  in  Benson  (1998a  and 
1998c)  can  generate  the  entire  weakly  efficient  set  in  the  outcome  space.  Since  the  work 
of  generating  the  entire  efficient  set  in  the  outcome  space  from  the  weakly  efficient  set  in 
the  outcome  space  is  generally  nontrivial,  we  need  algorithms  that  can  directly  generate 
the  entire  efficient  set  in  the  outcome  space. 
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As  we  know,  there  are  various  kinds  of  algorithms  for  finding  the  set  of  efficient 
extreme  points  in  the  decision  space  or  the  entire  efficient  decision  set  of  problem  MOLP. 
All  of  these  algorithms  are  based  in  part  on  some  kind  of  modified  simplex  method.  The 
idea  of  using  simplex  techniques  was  also  adapted  by  some  authors  to  develop  simple-like 
procedure  in  the  outcome  space  (see  e.g.  Dauer  and  Saleh,  1990;  Dauer  and  Liu,  1990). 
However,  all  these  simple-like  procedures  have  to  deal  with  certain  unfortunate 
difficulties,  such  as  tedious  bookkeeping,  backtracking,  and  degeneracy  of  extreme  points. 
To  overcome  these  problems,  we  would  like  to  develop  non-simplex-like  algorithms. 

Motivated  by  all  of  the  above  issues,  part  of  this  research  will  focus  on  developing 
new  outcome  space  based,  non-simplex-like  algorithms  for  solving  problem  MOLP. 

As  we  have  mentioned  earlier,  one  important  research  area  in  multiple  objective 
mathematical  programming  is  to  investigate  the  characteristics,  properties  and  structure  of 
the  efficient  set.  Among  the  properties  of  the  efficient  set,  closedness  is  of  interest.  One 
reason  is  that  some  algorithms  are  based  in  part  upon  this  property  (see  e.g.  Kornbluth  and 
Steuer,  1981).  However,  up  to  now,  there  are  only  a  few  results  about  the  closedness  of 
the  efficient  set  for  some  special  cases.  These  results  are  scattered  or  implied  in  several 
papers;  see  e.g.  Yu  and  Zeleny  (1975),  Schaible  (1983)  and  Choo  and  Atkins  (1983).  We 
will  give  a  review  on  these  results  in  Section  2.2.  The  reason  that  only  a  few  results  on 
closedness  are  reported  in  the  literature  is  probably  that  the  efficient  set  is  generally  not 
closed.  Even  when  all  of  the  objective  functions  are  continuous  and  strictly  qusaiconcave 
and  the  feasible  set  is  compact,  the  efficient  set  need  not  be  closed  (see  Choo  and  Atkins, 
1983).  Thus,  an  interesting  and  important  question  is  whether  or  not  there  are  general 
conditions  under  which  the  efficient  set  of  problem  MOMP  is  closed. 
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Motivated  by  this,  we  will  focus  part  of  this  research  on  investigating  necessary 
and  sufficient  conditions  for  the  efficient  decision  set  of  problem  MOMP  to  be  closed. 


1.3.  Contents  of  this  Research 

In  this  research,  we  will  present  two  new  outcome  space-based  algorithms  that 
may  be  potentially  useful  for  solving  large-scale  multiple  objective  linear  programming 

problems. 

One  algorithm  is  devoted  to  finding  the  set  of  all  efficient  extreme  points  in  the 
outcome  space  for  problem  MOLP.  Since  this  algorithm  is  based  on  the  decomposition  of 
the  weight  set.  We  will  call  it  Basic  Weight  Set  Decomposition  Algorithms  (BWSDA).  The 
algorithm  BWSDA  works  in  the  following  way:  At  each  iteration,  the  algorithm  will  first 
either  find  a  weight  vector  which  will  lead  to  an  unexplored  efficient  extreme  point  in  the 
outcome  space  or  conclude  that  all  points  in  Ye  r^  Yex  have  been  generated.  If  a  new 
weight  vector  is  found  at  some  iteration,  the  algorithm  will  in  the  next  iteration  call  for 
solving  at  most  (p+1)  linear  programs  in  order  to  find  an  unexplored  efficient  extreme 
point  in  the  outcome  space. 

Two  different  kinds  of  approaches  will  be  developed  for  finding,  if  it  exists,  a  new 
weight  vector  in  each  iteration  that  leads  to  an  unexplored  extreme  point  in  the  outcome 
space.  One  approach  uses  a  tree  search  method.  The  other  calls  for  solving  a  special 
concave  minimization  problem  over  a  polyhedron.  These  two  different  approaches  yield 
two    versions    of   the    Basic    Weight    Set    Decomposition    Algorithm,    Weight    Set 
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Decomposition  Algorithm-  I  (WSDA-  I)  and  Weight  Set  Decomposition  Algorithm-  II 

(WSDA-  II). 

The  other  algorithm  is  devoted  to  finding  the  entire  efficient  outcome  set  of 
problem  MOLP.  To  our  knowledge,  this  algorithm  is  the  first  one  capable  of  generating 
the  entire  efficient  outcome  set  of  a  multiple  objective  linear  programming  problem. 

The  remainder  of  this  research  is  focused  on  investigating  necessary  and  sufficient 
conditions  for  the  efficient  set  of  problem  MOMP  to  be  closed.  We  first  introduce  a  new 
definition  of  strict  quasiconcavity  for  a  vector-valued  fianction.  This  definition  extends  the 
definition  of  strict  quasiconcavity  for  a  real-valued  fiinction  to  vector-valued  ftjnctions. 
We  will  show  that  the  efficient  decision  set  of  a  general  MOMP  problem  is  closed  when 
the  vector- valued  fiinction  formed  by  the  objective  fianctions  is  strictly  quasiconcave  under 
our  new  definition  and  the  feasible  region  is  compact  and  convex.  For  the  special  case  of 
the  bi-objective  programming  problem,  we  will  extend  the  resuhs  obtained  by  Schaible 
(1983).  In  Schaible  (1983),  it  is  shown  that  the  efficient  decision  set  for  a  bi-objective 
programming  problem  is  closed  when  the  two  objective  fiinctions  are  continuous  and 
strictly  quasiconcave  and  the  feasible  region  is  compact  and  convex.  In  this  dissertation, 
for  the  bi-objective  programming  problems,  we  will  extend  Shaible's  results  to  cases 
where  the  feasible  region  need  not  be  convex  and  the  objective  fianctions  need  not  be 
strictly  quasiconcave. 
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1.4.  Organization  of  This  Dissertation 

The  dissertation  is  organized  in  the  following  way.  In  Chapter  2,  we  give  a 
literature  review  of  common  approaches  for  characterizing  efficient  solutions,  a  literature 
review  of  studies  on  closedness  of  the  efficient  set  of  problem  MOMP,  and  a  literature 
review  of  the  algorithms  for  solving  MOLP  problems.  In  Chapter  3,  we  will  study  some 
new  approaches  for  characterizing  efficient  solutions  and  some  necessary  and  sufficient 
conditions  for  the  efficient  set  of  problem  MOMP  to  be  closed.  New  definitions  for  the 
quasiconcavity  and  strict  quasiconcavity  of  a  vector-valued  function  are  also  given  in  this 
chapter.  In  Chapter  4,  we  will  give  two  new  algorithms  for  finding  the  set  of  all  efficient 
extreme  points  of  a  multiple  objective  linear  programming  problem  in  the  outcome  space. 
In  Chapter  5,  we  will  give  a  new  algorithm  for  finding  the  entire  efficient  set  of  a  multiple 
objective  linear  programming  problem  in  the  outcome  space.  Finally,  in  Chapter  6,  we  will 
discuss  some  ideas  for  further  research.      •  '.. '     >  »^  *  . 


CHAPTER  2 
LITERATURE  SURVEY 


In  this  chapter,  we  will  present  a  literature  review  of  some  important  approaches 
to  characterizing  efficient  solutions,  a  literature  review  of  the  closedness  of  the  efficient 
set  and  a  literature  review  of  the  algorithms  for  solving  multiple  objective  linear 
programming  problems.  >.  v, 

2.1.  Approaches  to  Characterizing  Efficient  Solutions 

In  order  to  operationalize  the  concept  of  an  efficient  solution,  a  common  idea  is  to 
relate  it  to  a  familiar  concept.  The  most  common  strategy  of  this  type  is  to  characterize 
efficient  solutions  in  terms  of  optimal  solutions  of  appropriate  scalar  optimization 
problems.  There  are  many  ways  of  forming  appropriate  scalar  problem  for  accomplishing 
this.  Among  them  are  two  kinds  of  commonly  used  scalar  optimization  problems.  These 
are  "the  weighting  problem"  and  "the  kth-objective  £• -constraint  poblem"  Since  our 
theoretical  results  and  algorithms  are  based  on  these  two  common  approaches,  we  will 
give  a  brief  review  on  these  two  kinds  of  scalar  optimization  problems  and  their 
relationships  with  the  MOMP  problem.  For  other  approaches  to  characterizing  efficient 
solutions  in  terms  of  appropriate  scalar  optimization  problems,  the  reader  is  referred  to  the 
book  by  Chankong  and  Haimes  (1983)  and  to  references  therein.  For  example,  a  strategy 
used  by  Sun  (1996)  is  to  characterize  efficient  solutions  of  an  MOMP  problem  in 
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RP  in  term  of  efficient  solutions  of  some  particular  MOMP  problems  in  R^'V  One 

advantage  of  this  strategy  is  that  we  can  use  the  induction  method  with  this  approach  to 

obtain  some  theoretical  results  (see  Sun,  1996). 

Let 

W=  {  w  =  (wi,  ...  ,  Wp)^  I  Wj  >  0  for  all  j  =  l,...,p  }, 

W"={  w  =  (w,,  ...  ,Wpf  |Wj>Oforallj  =  l,...,p}. 

We  will  refer  to  both  W  and  W"  as  the  weight  set  associated  with  the  MOMP. 

The  weighting  problem  can  be  defined  as  follows: 

p 
P(w):     max  ^Wjfj(x) 

St.    X  £  X, 

where  w  e  W  is  a  nonnegative  weight. 

The  weighting  problem  P(w)  has  been  used  to  analyze  the  efficient  solutions  since 
the  vector  maximization  problem  was  first  formulated  by  Kuhn  and  Tucker  in  1951.  Here 
we  will  state  three  major  results  which  show  relationships  between  P(w)  and  MOMP  in 
the  cases  that  fi,  ...,  fp  are  general  real-valued  functions,  concave  functions  and  linear 
functions,  respectively.  In  the  following.  Result  1  is  due  to  the  work  of  Geoflfrion  (1968), 
Zadeh  (1963)  and  Yu  (1974).  Result  2  is  due  to  Karlin  (1959).  Some  similar  results  can  be 
found  in  DaCunha  and  Polak  (1967),  and  Yu  (1974).  Result  3  is  due  to  Zeleny  (1974),  Yu 
and  Zeleny  (1975)  and  Isermann  (1976). 

Result  1.  X*  is  an  efficient  solution  of  MOMP  if  there  exists  w  e  W  such  that  x*  is 
an  optimal  solution  of  P(w)  and  either  one  of  the  following  two  conditions  holds: 
(i)  Wj>Oforallj  =  l,...,p; 
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(ii)  x'  is  the  unique  optimal  solution  of  P(w). 

For  a  given  weight  vector  w°,  if  we  solve  P(w°)  and  obtain  an  optimal  solution  x  , 
we  can  claim  from  Result  1  that  x*  is  an  efficient  solution  of  MOMP  if  either  x'  is  the 
unique  optimal  solution  of  P(w°)  or  w°  e  W°.  Thus,  Result  1  implies  that  we  can  find 
some  efficient  solutions  of  (MOMP)  by  solving  P(w)  for  some  properly  chosen  value  of  w. 

Result  2.  Assume  that  X  is  a  convex  set  and  fj  ,  j=l,...,p,  are  concave  on  X.  If  x' 
is  an  efficient  solution  of  (MOMP),  then  there  exists  w  g  W  such  that  x*  is  an  optimal 
solution  of  P(w). 

The  above  result  implies  that  under  the  convexity  assumptions  on  f  and  X,  we  can 
find  all  efficient  solutions  by  solving  P(w)  for  all  w  e  W.  Since  Result  2  does  not 
guarantee  the  efficiency  of  an  optimal  solution  of  P(w)  when  w  g  W,  we  need  to  verify 
whether  an  optimal  solution  of  P(w)  is  efficient. 

Result  3.  Assume  that  X  is  a  convex  polyhedron  and  fj,  j=l,...,p,  are  linear 
fijnctions.  Then,  x*  is  an  efficient  solution  of  (MOMP)  if  and  only  if  there  exists  a  weight 
vector  w  G  W"  such  that  x'  is  an  optimal  solution  of  P(w). 

The  above  Result  3  implies  that  the  set  of  all  efficient  solutions  of  a  muhiple 
objective  linear  programming  problem  can  be  found  by  solving  P(w)  for  all  w  e  W". 

Many  theoretical  results  and  algorithms  in  the  literature  on  multiple  objective 
mathematical  programming  are  based  upon  the  above  three  results.  Our  algorithms  in 
Chapter  4  and  Chapter  5  are  also  based  upon  Result  3.  In  Chapter  4,  we  will  decompose 
the  weight  set  W°  into  a  number  of  subsets.  Based  upon  this  decomposition,  we  will  then 
present  two  new  algorithms  for  finding  the  set  of  all  efficient  extreme  points  and  an 
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algorithm  for  finding  the  set  of  all  efficient  points  for  problem  MOLP  in  the  outcome 
space. 

The  kth-objective  8-constraint  problem  was  introduced  by  Haimes  (1970)  and 
Olagundoye  (1971),  and  it  can  be  defined  as  follows: 

Pk(s):       max  fk(x) 

s.t.      fj(x)>Sj,    j  =  l,...,p,j^k, 

xgX, 

where  e  =  (8i,...,  Sk-i,  Sk+i,..,  Sp)'^.  For  a  given  x*,  we  will  use  Pk(e*)  to  represent  the 
problem  Pk(s),  where  e  j  =  e  j*  =  fj(x*),  j^k.. 

■i    i  ■ 

The  theoretical  equivalence  between  Pk(s)  problems  and  a  general  MOMP  problem 
was  established  by  Haimes  et  al.  in  1971  and,  then,  was  extended  by  Chankong  and 
Haimes  in  their  book  in  1983.  Some  other  resuUs  for  general  MOMP  problems  were  also 
obtained  by  Lin  (1976,  1977).  Their  main  results  are  stated  in  the  following. 

Resuh  4.  Let  x*  be  an  optimal  solution  of  Pk(s*)  with  e  j*  =  fj(x*),  j  t^  k..  Then  x*  is 
an  efficient  solution  of  MOMP 

(i)  if  and  only  if  x*  is  an  optimal  solution  of  Pk(e*)  for  every  k  =  1,. .  .,p, 

(ii)  if  and  only  if  the  optimal  value  of  Pk(s)  is  strictly  less  than  fk(x*)  for  any  s>s'; 

(iii)  if  X*  is  the  unique  optimal  solution  of  Pk(e*)  for  some  k. 

The  sufficient  condition  for  efficiency  in  Result  4  (i)  requires  Pk(e)  to  be  solved  for 
all  k  before  a  conclusion  can  be  drawn.  The  sufficient  condition  in  Result  4  (ii)  requires 
one  to  compare  fk(x')  with  the  optimal  values  of  all  problems  Pk(s),  s  >  s*.  The  sufficient 
condition  in  Result  4  (iii)  requires  x*  to  be  the  unique  optimal  solution  of  Pk(s'). 
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Under  some  generalized  convexity  assumptions,  Sun  (1996)  obtained  the  following 
result. 

Result  5.  Let  X  c  R"  be  a  nonempty  compact  and  convex  set,  and  let  fi,  i  =  1,. . .,p 
be  continuous  and  quasiconcave  on  X,  If  fk  is  strongly  quasiconcave  on  X,  then  x  is  an 
efficient  solution  of  problem  MOMP  if  and  only  if  there  is  e  e  {(si,...,  Sk-i,  Sk+i,...,  Sp)  |  e, 
=  fi(y)  for  all  i  ;^  k,  y  G  X}  such  that  x*  is  an  optimal  solution  of  Pk(e*). 

In  this  research,  we  will  give  a  different  sufficient  condition  which  does  not  have 
these  requirements  for  an  optimal  solution  of  Pk(E)  to  be  efficient.  Some  necessary  and 
sufficient  conditions  for  the  efficient  set  to  be  closed  will  be  obtained  based  upon  this 
sufficient  condition. 


2.2.  Closedness  of  the  Efficient  Set 

One  important  research  area  in  the  theory  of  multiple  objective  mathematical 
programming  is  to  investigate  the  topological  properties  of  the  efficient  set  and  of  the 
weakly  efficient  set.  Among  these  properties,  closedness  is  of  particular  interest.  The 
closedness  of  the  efficient  set  and  of  the  weakly  efficient  set  is  both  theoretically  and 
algorithmically  important.  Following  are  some  reasons  for  this. 

(1)  The  closedness  of  the  efficient  set  guarantees  the  existence  of  at  least  one 
optimal  solution  for  the  problem  of  optimizing  a  continuous  function  over  the  efficient  set 
of  a  bounded  MOMP  problem. 

(2)  An  algorithm  for  finding  all  weakly  efficient  extreme  points  of  a  multiple 
objective  linear  fractional  programming  problem  that  was  proposed  by  Kombluth  and 
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Steuer  (1981),  is  based  in  part  on  the  facts  that  the  weakly  efficient  set  is  both  closed  and 

connected. 

(3)  The  closedness  of  the  efficient   set  in  bi-objective  strictly  quasiconcave 

programming  has  been  used  by  Daniilidis  et  al.  (1997)  to  prove  the  connectedness  of  the 

efficient  set  in  three-criteria  quasiconvex  programming. 

It  is  well  known  that  the  weakly  efficient  set  is  closed  when  the  objective  functions 

are  continuous  and  the  feasible  set  is  closed  (Choo  and  Atkins,  1983)     However  the 
efficient  set  is  not  closed,  in  general,  even  if  the  objective  functions  are  continuous  and 
strictly  qusaiconcave  and  the  feasible  set  is  compact  (Choo  and  Atkins,  1983,  Steuer, 
1986).  Up  to  now,  only  a  few  results  exist  concerning  the  closedness  of  the  efficient  set 
for  some  special  cases.  Yu  and  Zeleny  (1975),  for  instance,  showed  that  the  efficient  set  of 
a  multiple  objective  linear  programming  with  a  compact  feasible  region  can  be  represented 
by  the  union  of  its  maximal  efficient  faces.  Since  the  number  of  maximal  efficient  faces  is 
finite  and  each  maximal  face  is  closed,  the  efficient  set  of  a  multiple  objective  linear 
programming  problem  with  a  compact  feasible  region  is  closed.  Later,  Schaible  (1983) 
'   showed  that  the  efficient  set  of  a  bi-objective  programming  problem  is  closed  when  the 
objective  functions  are  continuous  and  strictly  quasiconcave  and  the  feasible  region  is 

compact  and  convex. 

As  a  result,  it  is  important  to  investigate  necessary  and  sufficient  conditions  for  the 
efficient  set  ofa  general  MOMP  problem  to  be  closed.  ,         ■ 
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2.3.  Methods  for  Solving  Multiple  Objective  Linear  Programming  Problems 

In  the  literature,  the  methods  for  solving  a  MOLF  problem  are  usually  classified 
into  three  categories  on  the  basis  of  the  time  at  which  the  DM  needs  to  articulate  his/her 
preference  structure  over  the  set  of  feasible  alternatives  (see  Hwang,  1979,  and  Evans, 

1984). 

The  first  category  consists  of  techniques  that  require  prior  articulation  of  the  DM's 
preferences.  This  means  that  the  preference  information  of  the  DM  is  given  to  the  analyst 
(who  is  responsible  for  solution  of  the  MOLF)  before  the  analyst  actually  solves  the 
problem.  The  information  may  be  either  (1)  cardinal  information,  or  (2)  mixed  (ordinal  and 

cardinal)  information. 

The  major  methods  using  the  approach  of  cardinal  information  are  utility  fiinction 
methods.  In  all  of  the  utility  fiinction  methods,  the  MOMP  (or  MOLF)  is  converted  to 

max  U(f)  =  U(f,,...,fp),  s.t.  x  g  X, 
where  U(f)  is  the  utility  fiinction  of  the  DM  over  the  multiple  objectives.  Thus  these 
methods  require  that  U(f)  be  known  prior  to  solving  the  MOMF  (or  MOLF).  The 
literature  on  utility  fiinction  methods  and  on  problems  of  determining  U(f)  is  discussed  and 
reviewed  in  Farquhar  (1977),  Huber  (1974),  Keeney  and  Raiflfa  (1976),  and  Dyer  and 
Sarin  (1979).  The  major  advantage  of  utility  fiinction  methods  is  that  if  U(f)  has  been 
correctly  assessed  and  used,  it  will  ensure  the  most  satisfactory  solution  to  the  DM.  The 
major  difficulty  with  the  utility  fiinction  methods  is  that  the  DM  is  required  to  articulate 
preference  judgements  in  an  information  vacuum. 
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The  methods  using  the  approach  of  mixed  (ordinal  and  cardinal)  information  are 
called  goal  programming  (Lee,  1973),  and  lexicographic  ordering  (Keeney  and  Raiffa, 

1976). 

Goal  programming  was  originally  proposed  by  Chames  and  Cooper  (1961)  for  a 
linear  model.  The  method  requires  the  DM  to  set  goals  that  he/she  wishes  to  attain  for 
each  objective  function.  A  preferred  solution  is  then  defined  as  the  one  that  minimizes  the 
deviations  from  the  set  goals.  In  the  most  common  formulation  of  goal  programming,  the 
DM,  in  addition  to  setting  goals  for  the  objective  functions,  must  also  be  able  to  give  an 
ordinal  ranking  of  the  objectives.  For  recent  developments  in  goal  programming,  we  refer 
the  reader  to  the  book  edited  by  Tamiz  (1996). 

The  lexicographic  method  requires  the  objective  functions  be  ranked  in  order  of 
importance  by  the  DM.  The  preferred  solution  obtained  by  this  method  is  the  one  that 
maximizes  the  objectives  starting  with  the  most  important  and  proceeding  according  to  the 
order  of  the  importance  of  the  objectives.  Since  the  obtained  solution  is  very  sensitive  to 
the  ranking  of  the  objectives  given  by  the  DM,  the  analyst  should  exercise  caution  in 
applying  this  method  when  some  obj  ectives  are  of  nearly  equal  importance 

The  second  category  of  methods  for  solving  problem  MOLP  consists  of  methods 
that  require  the  progressive  articulation  of  preferences  by  the  DM.  This  class  of  methods, 
generally  referred  to  as  interactive  methods,  relies  on  the  progressive  definition  of  the 
DM's  preferences  along  with  the  exploration  of  the  criterion  space.  The  progressive 
definition  takes  place  through  a  DM-analyst  or  DM-machine  dialogue  at  each  iteration. 

As  explained  by  Hwang  and  Masud  (1979),  and  Shin  and  Ravindran  (1991),  the 
advantages  of  the  interactive  methods  are  (1)  there  is  no  need  for  'a  priori'  preference 
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information;  (2)  they  each  yield  a  learning  process  for  the  DM  from  which  the  DM 
eventually  understands  the  behavior  of  the  system;  (3)  only  local  preference  information  is 
needed;  and  (4)  since  the  DM  is  part  of  the  solution  process,  the  solution  obtained  has  a 
better  prospect  of  being  implemented.  Again,  as  explained  by  Hwang  and  Masud  (1979), 
and  Shin  and  Ravindran  (1991),  the  disadvantages  are  (1)  solutions  depend  upon  the 
accuracy  of  the  local  preference  information  that  the  DM  can  give;  (2)  for  many  methods 
there  is  no  guarantee  that  the  preferred  solution  can  be  obtained  within  a  finite  number  of 
interactive  cycles;  (3)  much  more  effort  is  required  of  the  DM  than  in  the  methods  in  the 
previous  category;  (4)  nearly  all  interactive  methods  require  consistent  responses  from  the 

DM  to  be  successful. 

For  surveys  of  interactive  algorithms,  we  refer  to  Steuer  (1986)  and  Shin  and 

Ravindran  (1991).       '.- ^  t  ^  >.  '  '  ^" 

The  third  category  of  solution  methods  for  problem  MOLP  consists  of  methods 
that  require  posteriori  articulation  of  preferences.  Each  of  these  methods,  generally 
referred  to  as  vector  maximization  approaches,  typically  generates  all  or  a  substantial  part 
of  the  efficient  set.  The  efficient  set  or  the  subset  of  the  efficient  set  that  was  generated  is 
then  presented  to  the  DM  for  evaluation.  Since  our  algorithms  lie  in  this  category,  we  will 
give  a  more  detailed  review  of  the  algorithms  in  this  category. 

Algorithms  in  this  category  can  be  divided  into  two  subclasses  based  upon  the 

solutions  they  seek: 

(a)  those  which  concentrate  on  finding  a  representative  subset  of  the  efficient  set, 

(b)  those  which  concentrate  on  finding  the  entire  efficient  set. 
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Algorithms  in  this  category  can  also  be  classified  as  either  decision-space-based  or 
outcome-space-based  A  decision-space-based  algorithm  works  in  the  decision  space  and 
concentrates  on  finding  all  or  part  of  the  set  of  the  efficient  solutions.  An  outcome-space- 
based  algorithm  works  in  the  outcome  space  and  concentrates  on  finding  all  or  part  of  the 
set  of  efficient  objective  fiinction  values.  Most  current  algorithms  are  decision-space-based 

algorithms.  '  .  '   ; 

The  algorithms  in  subclass  (a)  include  those  of  Evans  and  Steuer  (1973a,  b), 
Zeleny  (1974),  Steuer  (1976a,  b),  Ecker  and  Kouada  (1978),  Armand  and  Malivert 
(1991),  Benson  and  Sayin  (1997),  Benson  (1998a,  c),  among  others.  The  algorithms  in 
Benson  and  Sayin  (1997)  and  Benson  (1998a,  c)  are  outcome-space-based  algorithms. 

The  algorithms  in  subclass  (b)  include  those  of  Yu  and  Zeleny  (1975),  Isermann 
(1977),  Gal  (1977),  Ecker  et  al.  (1980),  Armand  and  Malivert  (1991),  Armand  (1993), 
among  others.  All  of  these  algorithms  are  decision-space-based  algorithms. 

The  most  frequently  generated  representative  subset  of  the  efficient  decision  set  for 
the  algorithms  in  subclass  (a)  is  the  set  of  all  efficient  extreme  points  in  the  decision  space. 
The  rationale  for  generating  the  set  of  all  efficient  extreme  points  is  based  upon  the 
assumption  that  the  best  efficient  extreme  point  is  an  acceptable  approximation  of  a  best 
compromise  solution. 

Steuer  (1976a)  notes  that  algorithms  for  finding  all  efficient  extreme  points  in  the 
decision  space  generally  consist  of  three  phases.  Phases  I  and  II  consist  of  finding  an  initial 
extreme  point  and  an  initial  efficient  extreme  point,  respectively.  Phase  III  involves  finding 
all  remaining  efficient  extreme  points.  Phases  I  and  II  are  easy  to  implement  and  only 
require  classical  linear  programming  procedures.  Phase  III  is  where  the  various  algorithms 
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differ  in  their  approaches,  Steuer  also  notes  that  there  are  three  classes  of  approaches  for 
Phase  III  among  those  algorithms  for  finding  all  efficient  extreme  points  in  the  decision 
space.  The  three  classes  are 

the  decomposition  of  parametric  space  approach; 
the  adjacent  efficient  basis  approach; 
the  adjacent  efficient  extreme  point  approach. 

We  will  give  a  detailed  discussion  of  the  decomposition  of  the  parametric  space 
approach  later  in  Chapter  4.  The  adjacent  efficient  basis  approach  involves  pivoting  among 
all  efficient  bases.  The  adjacent  efficient  extreme  point  approach  involves  the  pursuit  of  all 
efficient  edges  emanating  from  each  efficient  extreme  point.  All  of  these  algorithms  use 
modified  simplex  method  approaches.  .  . 

One  general  difficulty  of  these  algorithms  concerns  the  handling  of  degeneracy.  It 
is  will  known  that  several  bases  may  correspond  to  a  single  degenerate  vertex.  Since  all  of 
these  methods  use  basic  feasible  solutions  to  characterize  the  extreme  points  of  the 
feasible  region,  this  makes  the  determination  of  all  efficient  extreme  points  more 
complicated  when  degeneracy  is  present.  To  deal  with  degeneracy,  some  special  pivoting 
rules  are  used  in  Armand  and  Malivert  (1991). 

It  is  well  known  that  the  efficient  decision  set  of  a  MOLP  problem  can  be 
decomposed  into  the  union  of  its  maximal  efficient  faces  in  the  decision  space  (Yu  and 
Zeleny,  1975).  Each  efficient  face  is  completely  determined  by  the  efficient  extreme  points 
and  extreme  rays  that  lie  in  it.  Thus,  the  algorithms  for  finding  the  entire  efficient  decision 
set  in  subclass  (b)  usually  work  in  the  following  way.  First,  all  efficient  extreme  points  and 
extreme  rays  are  generated.  Next,  some  identification  and  bookkeeping  techniques  are 
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usually  used  to  generate  all  maximal  efficient  faces.  All  of  these  algorithms  are  also  based 
upon  some  type  of  modified  simplex  method  approach  and  must  deal  with  the  degeneracy 

problem. 

Apart  from  the  computational  burden  of  employing  these  decision-space-based 
methods  and  the  complications  induced  by  the  presence  of  degeneracy,  there  are  a  number 
of  other  problems  related  to  these  algorithms.  One  problem  is  that  the  efficient  decision  set 
is  generally  a  complicated  nonconvex  set  that  grows  rapidly  as  the  size  of  the  problem 
increases.  Thus,  generating  the  set  in  its  entirely  is  possible  only  in  certain  special  cases. 
Another  problem  is  that  the  size  and  nature  of  the  generated  set  in  the  decision  space  can 
easily  overwhelm  the  DM.  It  has  been  noted  (Dauer,  1987,  1990,  and  Benson,  1995a)  that 
since  the  number  of  objective  functions  is  usually  much  less  than  the  number  of  variables 
in  problem  MOMP,  the  efficient  outcome  set  has  a  much  simpler  structure  than  the 
efficient  decision  set.  Recently,  some  researchers  have  begun  to  develop  tools  for 
analyzing  problem  MOLP  in  the  outcome  space,  rather  than  in  the  decision  space  of  the 

problem. 

To  our  knowledge,  the  first  algorithm  that  is  capable  of  generating  the  set  of  all 
efficient  extreme  points  in  the  outcome  space  for  a  general  MOLP  problem  was  proposed 
by  Benson  in  1998  (Benson,  1998a).  This  algorithm  uses  outer  approximation  techniques 
from  global  optimization  (Horst  and  Tuy,  1993).  It  works  by  generating  a  finite  number  of 
polyhedra  that  each  approximates  an  "efficiency-equivalent"  outcome  polyhedron  for  the 
problem.  The  most  computationally-demanding  task  in  the  algorithm  calls  for  determining 
the  set  of  extreme  points  of  each  new  polyhedron  that  is  created  by  adding  a  linear 
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inequality  cut  at  each  step  of  the  algorithm.  This  is  accomplished  with  the  aid  of  outer 

approximation. 

A  newer  outcome-space-based  method  for  multiple  objective  linear  programming, 
called  a  hybrid  approach,  has  also  been  proposed  by  Benson  (1998c).  This  approach 
adapts  two  global  optimization,  decision  set-based  methods  to  the  outcome  space.  These 
methods  are  a  special  simplicial  partitioning  technique  of  Ban  (see  Ban,  1983,  and  Tuy  and 
Horst,  1988),  proposed  originally  for  solving  concave  minimization  problems,  and  a 
general  outer  approximation  method  that  has  been  used  very  frequently  to  help  solve  a 
variety  of  global  optimization  problems  (see  Horst  and  Tuy,  1993,  and  Horst  and 
Pardalos,  1995).  In  particular,  the  simplicial  partitioning  technique  is  systematically 
imegrated  into  the  outer  approximation  scheme  in  outcome  space  to  determine  all  efficient 
extreme  points  in  the  outcome  set  of  the  problem  in  a  finite  number  of  iterations. 

To  our  knowledge,  there  are  no  direct  algorithms  for  finding  the  entire  efficient 
outcome  set.  The  algorithms  in  Benson  (1998  a,  1998c),  however,  can  be  used  to  find  the 
entire  weakly  efficient  outcome  set. 

As  discussed  in  Section  1.2,  it  is  important  to  develop  new  outcome-space-based 
algorithms  for  finding  the  set  of  all  efficient  extreme  points  in  the  outcome  space,  and  to 
develop  algorithms  for  finding  the  entire  efficient  outcome  set  directly. 


CHAPTER  3 
ON  THE  CLOSEDNESS  OF  THE  EFFICIENT  SET  OF  PROBLEM  MOMP 


We  restate  problem  MOMP  as  follows:  '■-._'"'' 

MOMP:        v-max  f(x)  =  (fi(x),  . . .  ,  fp(x)f  , 

s.t.  X  eX,  '       ~    ..  .:■. 

where  p  >  2,  x  e  R"  is  a  vector  of  decision  variables,  f;,  i  =  1 ,2, . . .  ,p  are  objective  functions 
and  X  is  the  set  of  feasible  decision  alternatives.  Since  problem  MOMP  has  p  objective 
functions,  we  call  it  a  p-dimensional  multiple  objective  mathematical  programming 
problem  (or  a  p-dimensional  MOMP  problem).  The  vector-valued  function  f  X-^R^  is 
called  a  p-dimensional  vector-valued  function.  The  efficient  decision  set  and  weakly 
efficiem  decision  set  of  problem  MOMP  are  denoted  by  E(f,  X)  and  Ew(f,  X),  respectively. 
The  efficient  outcome  set  and  weakly  efficient  outcome  set  of  problem  MOMP  are 
denoted  by  E(f(X),  R^, )  and  E„(f(X),  R^ ),  respectively. 

One  important  research  area  in  the  theory  of  multiple  objective  mathematical 
programming  is  to  investigate  the  topological  properties  of  the  efficient  set  and  of  the 
weakly  efficient  set.  Among  these  properties  closedness  is  of  interest.  The  closedness  of 
the  efficient  set  and  of  the  weakly  efficient  set  are  both  theoretically  and  algorithmically 
important  (c.f  Section  1.2  and  Section  2.2). 

It  is  well  known  that  the  weakly  efficient  decision  set  E„(f,  X)  is  closed  when  the 
objective  functions  are  continuous  over  X  and  the  feasible  set  is  closed  (Choc  and 
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Atkins,  1983).  However  the  efficient  decision  set  is  not  closed  in  general,  even  if  the 
objective  fianctions  are  continuous  and  strictly  qusaiconcave  on  X  and  the  feasible  set  is 
compact  (Choo  and  Atkins,  1983;  Steuer,  1986).  As  mentioned  earlier,  the  only 
closedness  results  for  the  efficient  set  that  exist  in  the  literature  concern  certain  special 
cases  (see,  e.g.,  Section  2.2).  Thus  the  question  as  to  what  the  necessary  conditions  are 
for  the  efficient  set  of  a  general  MOMP  problem  to  be  closed  remains  open.  The  question 
as  to  whether  or  not  we  can  find  any  sufficient  conditions  for  the  efficient  set  of  a  general 
MOMP  problem  to  be  closed  also  remains  open. 

Motivated,  in  part,  by  answering  these  questions,  we  focus  this  chapter  on  finding 
necessary  and  sufficient  conditions  for  the  efficient  decision  set  E(f,  X)  of  problem  MOMP 
to  be  closed.  We  will  first  introduce  a  new  definition  of  strict  quasiconcavity  for  a  vector- 
valued  fiinction.  This  definition  extends  the  definition  of  strict  quasiconcavity  for  a  real- 
valued  fiinction  to  vector-valued  fimctions.  It  is  shown  that  a  vector-valued  fiinction  is 
strictly  quasiconcave  on  a  compact  convex  set  X  if  each  of  its  component  fimctions  is 
strongly  quasiconcave  or  if  each  of  its  component  fimctions  is  linear  and  X  is  a  polytope. 
We  also  show  that  the  reverse  of  the  above  relations  may  not  be  true.  Under  our  new 
definition,  it  is  shown  that  the  efficient  decision  set  E(f,  X)  of  problem  MOMP  is  closed 
when  the  vector-valued  fiinction  fi^x)  is  strictly  quasiconcave  and  the  feasible  region  X  is 
compact  and  convex.  Some  other  sufficient  conditions  are  also  obtained.  By  applying 
some  of  the  new  results  to  bicriteria  mathematical  programming  problems,  we  obtain  a 
new  result  on  the  closedness  of  E(f,  X),  which  extends  a  result  obtained  by  Schaible 
(1983).  In  Schaible  (1983),  it  is  shown  that  the  efficient  decision  set  for  a  bicriteria 
programming  problem  is  closed  when  the  two  objective  fimctions  are  continuous  and 
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strictly  quasiconcave  and  the  feasible  region  is  compact  and  convex.  Here,  for  the 
bicriteria  programming  problem,  we  extend  Shaible's  result  to  cases  where  the  feasible 
region  need  not  be  convex  and  the  objective  functions  need  not  be  strictly  quasiconcave.  A 
necessary  condition  for  E(f,  X)  to  be  closed  will  also  be  given  in  this  chapter. 

This  chapter  is  organized  in  the  follow  way.  In  Section  3.1,  we  introduce  some 
notation  and  review  the  definitions  of  upper  semicontinuous  and  lower  semicontinuous 
point-to-set  maps.  In  Section  3.2,  we  introduce  and  study  new  definitions  for  a  vector- 
valued  function  to  be  quasiconcave  and  strictly  quasiconcave.  Some  new  results  on 
characterizing  the  efficient  set  of  a  p-dimensional  MOMP  problem  in  terms  of  the  optimal 
solution  sets  of  some  single-valued  optimization  problems  and  in  terms  of  the  efficient  sets 
of  some  (p-l)-dimensional  MOMP  problems  are  given  in  Section  3.3.  In  Section  3.4,  we 
present  some  necessary  and  sufficient  conditions  for  the  efficient  set  of  a  general  MOMP 
problem  to  be  closed.  The  results  on  the  closedness  of  a  bicriteria  programming  problem 
are  given  in  Section  3.5.  Finally,  some  concluding  remarks  are  given  in  Section  3.6. 

3.1.  Definitions  and  Notation 

Suppose  that  X  e  R"  is  a  nonempty  and  compact  set,  and  that  fi,  i  =  1,  2,  . . .,  p,  are 
continuous  fianctions  on  X.  We  define 

f,  =  min  {fi(x)  I  X  e  X},  (31) 

f.  =  max  {fi(x)  I  X  e  X},  (3.2) 

f(i)(x)  =  (f,(x),...,  f,.i(x),  fi.,(x),...,  fp(x))\  (3.3) 

and 
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f(i)(X)={f(i)(x)|xEX},  (3.4) 

for  all  i  =  1,  2,. .  .,p.  Notice  that  f(i)(x)  is  a  (p-l)-dimensional  vector-valued  ftinction  on  X  if 
p  >  2,  and  f(i)(X)  is  a  nonempty  set  in  R'''  . 

Let  i  e  (1,  2,  ...,p}.  For  any  t  G  [f,  ,f,  ],  and  e  G  f(i)(X),  we  define 

Xi(t)  =  {x  G  X  I  fi(x)  >  t},  ■■':    ■      ■     '■   '  (3.5) 

and 

X(i)(e)=(xGX|f(i)(x)>e}.  '  (3.6) 

Let  y  =  (yi, . . .  ,y J^,  z  =  (zi, . . .  ,z^f  be  any  two  vectors  in  R"*  with  m  >  1 .  We  define 

^min{y,,z,}^ 


min  (y,  z}  = 


(3.7) 


l^min{y„,z„}J 

Let  F  be  a  point-to-set  map  from  a  set  U  c  R*"  to  subsets  of  a  set  V  c  R",  and  let 
U'  c  U.  Then,  the  union  of  the  sets  F(u)  for  u  g  U'  is  denoted  by  u{F(u)|  u  g  U'},  and  the 
intersection  of  the  sets  F(u)  for  u  g  U'  is  denoted  by  n{F(u)|  u  e  U') . 

Now,  we  review  the  concepts  of  upper  semicontinuous  and  lower  semicontinuous 

point-to-set  maps. 

Definition  3 .  L 1 .  Let  F  be  a  point-to-set  map  from  a  set  U  c  R^  to  subsets  of  a  set 

V  c  R".  Then,  F  is  said  to  be 

(a)  upper  semicontinuous  at  a  point  u*  g  U,  if  {u""}  c  U,  u''  ^  u*  (when  k  ^  cc) 
and  v''  G  F(u'')  with  v"*  -^  v*  (when  k  ^  oc)  imply  that  v*  e  F(u*); 

(b)  lower  semicontinuous  at  a  point  u*  g  U,  if  (u''}  e  U,  u''  ^  u*  (when  k  ^  qc) 
and  V*  G  F(u*)  imply  the  existence  of  an  integer  M  and  a  sequence  of  points  (v  }e  V 
such  that  v''  g  F(u'')  for  all  k  >  M  and  v''  -^  v*  when  k  ^  x. 
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3.2,  Quasiconcave  and  Strictly  Quasiconcave  Vector- Valued  Functions 

The  definitions  of  quasiconcavity,  strict  quasiconcavity,  and  strong  quasiconcavity 
for  a  real-valued  function  can  be  stated  as  follows. 

Definition  3.2.1.  Let  S  e  R"  be  convex,  and  let  g  be  a  real-valued  function  defined 
on  S.  Then,  g  is  said  to  be  ^ 

(a)  quasiconcave  on  S,  if 

g(U' +  (l-X)x')  >  min  {g(x'),  g(x')} 

foranyx\x^G  S,  ?^g(0,  1); 

Qd)  strictly  quasiconcave  on  ?i,'\i 

g(>.x' +  (l-?.)x')  >  min  {g(x'),  g(x')} 
for  any  x\  x'  e  S,  g(x')  ^  g(x'),  and  X  g  (0,  1); 

(c)  strongly  quasiconcave  o«  S,  if  •    ^l 

.     g(?ix'  +  (l-X)x')>min{g(x'),g(x')} 
for  any  x\  x'  g  S,  x'  ^^  x',  and  ?i  g  (0,  1).         '     '  '  '*  , 

We  now  review  some  properties  that  we  will  need  concerning  the  quasiconcavity 
and  strict  quasiconcavity  of  real-valued  functions.  For  an  excellent  review  of  various 
properties  of  quasiconcave  and  strictly  quasiconcave  functions,  we  refer  the  reader  to  the 
book  by  Avriel  et  a/.  ( 1 988). 

The  following  property  is  well  known.  It  can  be  proved  directly  from  the 
definition. 
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Property  3.2. 1  Let  g  be  a  real-valued  function  defined  on  the  convex  set  S  c  R". 
Then,  g  is  quasiconcave  on  S  if  and  only  if  the  level  set 

L(a)  =  {xe  S|g(x)>a} 
is  convex  for  any  scalar  a  g  R'  such  that  L(a)  ;^  0. 

The  following  properties  will  be  useful  in  this  chapter. 

Property  3.2.2  (Karamardian,  1967).  Let  g  be  a  continuous  real-valued  function 
defined  on  the  convex  set  S  c  R".  If  g  is  strictly  quasiconcave  on  S,  then  it  is  also 

quasiconcave  on  S. 

Property  3.2.3  (Elkin,  1968,  Martos,  1969).  Let  g  be  a  continuous  quasiconcave 
real-valued  function  defined  on  the  convex  set  S  c  R".  Then,  g  is  strictly  quasiconcave  on 
S  if  and  only  if  every  local  maximum  of  g  in  S  is  also  a  global  maximum  of  g  on  S. 

Property  3.2.4  (Zang  and  Avriel,  1975).  Let  g  be  a  real-valued  function  defined  on 
the  convex  set  S  c  R".  Then,  L(a)  is  a  lower  semicontinuous  point-to-set  map  on  G  =  {a  | 
L(a)  ?!:0}if  and  only  if  every  local  maximum  of  g  in  S  is  also  a  global  maximum  on  S. 

From  Properties  3.2.2-3.2.4,  we  immediately  have  the  following  result  concerning 
strictly  quasiconcave  fijnctions. 

Property  3.2.5.  Let  g  be  a  continuous  real-valued  Sanction  defined  on  the  convex 
set  S  c  R".  Then,  g  is  strictly  quasiconcave  if  and  only  if  g  is  quasiconcave  on  S  and  L(a) 
is  a  lower  semicontinuous  point-to-set  map  on  G  =  {a  |  L(a)  ;t0} . 

Properties  3.2.1  and  3.2.5  imply  the  following  alternative  definitions  for 
quasiconcave  and  strictly  quasiconcave  functions. 

Definition  3.2.2.  Let  S  e  R"  be  convex,  and  let  g  be  a  continuous  real-valued 
function  defined  on  S.  Then,  g  is  said  to  be 
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(a)  quasiconcave  on  S,  if  the  level  set  - 

L(a)  =  {X  e  S|  g(x)  >  a} 
is  convex  for  any  a  e  R'  such  that  L(a)  ^  0; 

(b)  strictly  quasiconcave  on  S,  if  g  is  quasiconcave  on  S  and 

L(a)=(xeS|g(x)>a} 
is  a  lower  semicontinuous  point-to-set  map  on  G  =  (a  |  L(a)  ^0). 

We  now  extend  Definition  3.2.2  to  vector-valued  functions.  To  aid  in  this 
extension,  we  define  a  vector-valued  fijnction  to  be  continuous  on  a  set  if  each  of  its 
component  functions  is  continuous  on  the  set. 

Definition  3 .2.3 .  Let  f(x)  =  (fi(x), . . . ,fp(x))^  be  a  p-dimensional  continuous  vector- 
valued  fijnction  defined  on  the  convex  set  X  c  R".  Then,  f  is  said  to  be 

(a)  quasiconcave  on  X,  if  the  level  set 

M(Y)={xeX|fi[x)>Y} 
is  convex  for  any  y  e  R*"  such  that  M(y)  ^  0; 

(b)  strictly  quasiconcave  on  X,  if  f  is  quasiconcave  on  X  and  the  point-to-set  map 

M(Y)={xGX|f(x)>Y} 

is  lower  semicontinuous  on  G'  =  (y  6  R"'  I  M(y)  ^  0}- 

We  now  present  some  properties  of  quasiconcave  vector-valued  fiinctions  and 
strictly  quasiconcave  vector-valued  fijnctions.  Some  of  these  properties  will  be  used  later 
in  this  chapter  in  the  proofs  of  our  results  on  closedness.  In  addition  to  this,  these 
properties  also  show  us  the  relationships  among  various  classes  of  generalized  convex 
Sanctions  and  linear  fijnctions. 


V 
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Theorem  3.2.1.  Let  f(x)  =  (fi(x),  ...,  fp(x)f  be  a  p-dimensional  continuous  and 
quasiconcave  vector-valued  function  defined  on  the  convex  set  X  c  R".  Assume  that 
{ii,...,ik}  c=  {1,  2,...,p},  where  1  <  k  <  p.  Then,  f'(x)  =  (f,_(x),...,f,^(x)f  is  continuous 

and  quasiconcave  on  X. 

Proof.  We  only  need  to  prove  the  case  where  k  =  p-1.  Without  loss  of  generality, 
we  assume  that  (ii,...,ik}  =  {1,..,  p-U-  Choosey'  e  RP''  such  that  (x  e  X|  f  (x)  >  y'  }  ^ 
0.  Let  y,  z  G  {x  G  X|  f '(x)  >  y'  }•  Since  X  is  convex,  we  have 

Xy  +  (\-X)zGX  ■     - 

for  any  0  <  ?i  <  1.  Since  y,  z  g  {x  g  X|  f'(x)  >  y'  },  we  have  f'(y)  >  y'  and  f  (z)  >  y'.  It 
follows  that 

min{f(y),f'(z)}^Y'- 
Let  y  =  min  {%),  f(z)}.  Then,  y,  z  g{x  g  X|  f(x)  >  y  }.  Since  f  is  quasiconcave,  we  have 

that  (x  G  X|  f(x)  >  y  }  is  convex.  It  follows  that 

Xy  +  (l-X)zG{xGX|f(x)>y}       ; 

for  any  0  <  X  <  1 .  That  is  '       v  ''t 

f(Xy  +  (l-X)z)>y  =  min{f(y),f(z)}. 
This  implies  that  f '(Xy  +  (l-^)z)  ^  min  (f '(y),  f '(z)}  >  y'  for  any  0  <>.  <  1 .  As  a  resuh,  the 
set  {x  G  X|  f  (x)  >  y' }  is  convex.  By  Definition  3.2.3,  f  is  quasiconcave  on  X.  D 

Theorem  3.2.2.  Let  f(x)  =  (fi(x),  . . .,  fpCx))"^  be  a  p-dimensional  continuous  vector- 
valued  function  defined  on  the  convex  set  X  c  R".  Then,  the  vector-valued  fiinction  f  is 
quasiconcave  on  X  if  and  only  if  each  of  its  component  fianctions  fi,  i  =  1,  2,  ...,p,  is 
quasiconcave  on  X. 
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Proof.  If  f  is  quasiconcave  on  X,  then  it  follows  from  Theorem  3  2.1  that  every 
component  function  of  f  is  quasiconcave  on  X. 

Now,  we  assume  that  every  component  function  fi  is  quasiconcave  on  X  for  i  g 
(1,. , , ,p).  To  prove  f  is  quasiconcave  on  X,  we  need  to  prove  that  the  level  set 

M(;^)=(xeX|f(x)>/} 

is  convex  for  any  y  in  R**  with  M(x )  '^  0 

Let  Y  *  be  any  given  point  in  R^  such  that  M(/  *)  ^^  0,  and  let  x,  y  g  M(y  *). 
Then,  f{x)>  y*  and  f(y)  >  y*.  Since  fi  is  quasiconcave  on  X  for  each  i  =l,...,p,  we  have 


that 


f(;ix  +  (l-A)y)  = 


f,(Ax  +  (l-;i)y) 


l^fp(Ax  +  (l-A)y) 
^min{f,(x),f,(y)}^ 


min{f  (x),f  (y)} 


pvj/jy 


=  mm{{(x)J(y)}>y* 
for  any  0  <  A<  1.  This  impHes  Ax  +  (l-A)y  e  Miy  *)  for  any  0  <  A  <  1.  Therefore, 
M(;' *)  is  a  convex  set.  L] 

Theorem  3 .2.3 .  Let  f(x)  =  (fi(x),  . . . ,  fp(x))^  be  a  p-dimensional,  continuous  strictly 

:     •     '       ,  .  ■    ■•  •■  V-'""- 

quasiconcave  vector-valued  function  defined  on  the  compact,  convex  set  X  c  R".  Assume 
that  {ii,...,ik}  c  (1,  2,...,p},  where  1  <  k  <  p.  Then  f'(x)  =  (fi_  (x),...,f,^(x)f  is  strictly 


quasiconcave  on  X. 


^,  XI  -ti;  •;»  f 
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Proof.  We  only  need  to  prove  the  case  where  k  =  p-1 .  Without  loss  of  generality, 

we  assume  that  {ii,...,ik}  ^  (I,--,  p-1}- 

Since  f  is  continuous  and  strictly  quasiconcave  on  X,  we  have  that  it  is  also 
quasiconcave  on  X.  It  follows  from  Theorem  3.2,1  that  f'(x)  =  (f,(x),...,fp.,(x)f  is 
quasiconcave  on  X.  Therefore,  to  complete  the  proof,  we  need  only  to  prove  that  the 


point-to-set  map 


M'(y)  =  {xeX|f(x)>/} 


'M. 


is  lower  semicontinuous  onG  ^  {y  e  R''''|  M'(/ )  '^  0}- 

Towards  this  end,  \qX  y  *  &  G\  {y^}  ^G,  zmd  y^  ^  y  *  when  k  ->  x,  and  let  x* 
e  M'(x  *)•  By  definition,  to  prove  that  M'(r )  is  lower  semicontinuous  at  y  *,  we  need  to 
find  an  integer  K  and  a  sequence  (x'^jsuch  that  x''  g  M'(/  ^)  for  k  >  K  and  x''  -^  x*  when  k 


-^oc. 


Since  f  is  continuous  on  the  compact  set  X,  fp(x)  has  minimum  value  on  X.  Let 


/?  *  =  min  {fp(x)  I  X  e  X},  and  let  t^ 


Then,  fp(x*)  >  yf?  *.  This,  together  with  x^ 


G  M{y  *),  yields  f(x*)  >  t*.  Therefore,  x*  g  M(t*)  =  {  x  g  X]  f(x)  >  t*).  Let  t 

for  k  =  1,  2,. ...  We  have  t''  -»  t*  when  k  -^  oc.  Since  >'  "^  g  G'  (k  =  1,  2,. . .),  it  follows  that 
there  exists  y'' G  X  such  that  - 


f '(/)  >  y ' 


■41  y  •. 

for  all  k  =  1,  2,. . . .  Since  /? *  =  min  {fp(x)  j  x  e  X},  we  have  fp(/)  >  p*.  Therefore,  f(y'') 


> 


=  t''  for  k  =  1,2....  It  follows  that  t"'  g  G  =  {t  e  R^  M(t)  ^  0}  for  any  k.  As  a 


* 


resuh,  since  f  is  continuous  on  the  compact  set  X,  we  can  show  that  t*  g  G.  Therefore,  t 
G  G,  and  we  have  found  a  vector  x*  g  M(t*)  and  a  sequence  of  vectors  {t*"}  e  G  such 
that  t''  -^  t*  when  k  ^  oc.  Since  f  is  strictly  quasiconcave  on  X,  the  point-to-set  map  M(t) 
=  {  X  G  X|  f(x)  >  t}  is  lower  semicontinuous  at  t*  g  G  =  {t  e  R""!  M(t)  ^  0}.  Therefore, 
there  exist  an  integer  K  and  a  sequence  of  vectors  {x''}  such  that  x''  g  M{^)  for  k  >  K  and 
x"^  -^  X*  when  k  ^  oc.  That  is,  there  exist  an  integer  K  and  a  sequence  {x''}  such  that  x  g 
M{y^)  for  k  >  K  and  x''  ->  x*  when  k  ->  oc.  This  impHes  that  M'(r)  is  lower 
semicontinuous  at  y*.  By  the  choice  of  /  *,  this  impHes  that  M'(r)  is  lower 
semicontinuous  on  GV  Consequently,  the  proof  is  complete.  □ 

Before  going  further,  we  need  to  prove  a  lemma.  Consider  the  system 

Du  =  v* 

u"y*  =  0  »   -      .  ,.  ,»  (3-8) 

■  •■..    ..'  ;  •  -M^. '       ...  .    . 

u>0,  '  5 

where  D  is  a  n  x  q  matrix,  v*  g  R"  and  y*  g  R"*  are  two  given  vectors,  and  y*  >  0.  Let  I  = 
{i|  yi*  :it  0,  i  =  1,. .  .,q}.  Let  Ui  =  0  for  i  g  I,  and  let  u'  be  the  vector  whose  elements  are  uj,  i 
e  {l,...,q}\I.  Then,  the  above  system  is  equivalent  to  the  linear  system 

fD'u'  =  V* 

J^"  (3.9) 

lu'>0, 
where  D'  is  a  submatrix  of  D. 


•    .V 


42  '"■    ^         ■  ■^•'•f 


If  the  system  (3.8)  is  consistent,  then,  from  linear  programming  theory,  there  is  a 
nonsingular  submatrix  of  D',  denoted  by  B,  and  a  subvector  of  v*,  denoted  by  v',  such  that 


u*  = 


V    0    7 


is  a  solution  of  (3.8).  Notice  that  ||vl|  <  ||v*||.  Therefore,  ||u*||  =  ||B'V'||  <  ||B- 
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||v'||<  ||B''||  ||v*||,  where  ||B''||  =  max  {||B'V||  |  ||v||  =  1}.  Notice  that  since  B  is  a 
nonsingular  submatrix  of  D',  it  is  also  a  nonsingular  submatrix  of  D.  Let  M  =  max  {||B'  ||  | 
B  is  a  nonsingular  submatrix  of  D}.  Then,  ||u*||  <  M||v*||.  Consequently,  we  have  proven 
the  following  lemma,  which  will  be  used  in  the  proof  of  Theorem  3 .2.4  (c). 

Lemma  3.2.1.  Let  D  be  an  n  x  q  matrix,  let  v*  e  R"  and  y*  e  R'*  be  two  given 
vectors  with  y*  >  0,  and  let  M  =  max  {||B"'||  |  B  is  a  nonsingular  submatrix  of  D}.  If 
system  (3.8)  is  consistent,  then  it  has  a  solution  u*  such  that  ||u*||  <  M||v*||. 

Theorem  3.2.4.  Let  f(x)  =  (fi(x),  ...,  fp(x))'^  be  a  p-dimensional  continuous  vector- 
valued  function  defined  on  the  nonempty  compact,  convex  set  X  c  R". 

(a)  If  the  vector-valued  function  f  is  strictly  quasiconcave  on  X,  then  the  real- 
valued  function  f;  is  strictly  quasiconcave  on  X  for  each  i  =  1 , . . . ,  p. 

(b)  If  the  real-valued  functions  fi,  i  =  l,...,p  are  strongly  quasiconcave  on  X,  then 
the  vector- valued  function  f  is  strictly  quasiconcave  on  X. 

(c)  If  the  real-valued  functions  fi,  i  =  l,...,p  are  linear  functions  and  X  is  a 
polytope,  then  the  vector-valued  function  f  is  strictly  quasiconcave  on  X. 

Proof  (a)  The  resuh  follows  immediately  from  Theorem  3.2.3,  Definition  3.2.2, 
Definition  3.2.3,  and  Property  3.2.5. 

(b)  Since  fi,  i  =  l,...,p  are  strongly  quasiconcave  on  X,  they  are  also  quasiconcave 
on  X.  It  follows  from  Theorem  3.2.2  that  the  vector-valued  function  f  is  quasiconcave  on 
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X.  So,  by  the  definition  of  strict  quasiconcavity  we  only  need  to  prove  that  the  point-to- 
set  map  ;k  -^  M(x )  =  {x  e  X|  f(x)  >  /  }  is  lower  semicontinuous  at  any  given  point  /  *  in 
RP  such  that  M(/  *)  ^  0.  Towards  this  end,  let  ^  *  g  R^  satisfy  M{r  *)^  0  .Let  {y^}  Q 
G'  =  {r\M(r)^0},  r^  -^  r*  when  k  ->  X  ,  and  X*  G  M(y  *).  Since  X  is  a  compact 
set,  M(y^)  is  a  nonempty  compact  set  for  each  k.  Therefore,  we  may  choose  x""  g  M(/  ) 

for  each  k  such  that 

||x''-x*||  =  min  {||x-x*||  I  X  G  M(/')}. 

Assume  that  y*  is  a  cluster  point  of  the  sequence  {x''}  and  y*  ^  x*.  Then,  there  is  a 
subsequence  of  {x''}  convergent  to  y*.  Without  loss  of  generality,  we  assume  that  x''  ->  y* 
when  k  ->  X.  Then,  ||x''  -  x*||  -^  ||y*  -  x*||  when  k  ->  x.  So,  there  is  a  positive  integer  Ki 

such  that  for  all  k  >  Ki, 

|||x''-x*||-||y*-x*|||<0.5||y*-x*||. 

Therefore, 

||x''-x*|l>0.5||y*-x*||  '',  (3.10) 

when  k  >  Ki. 

For  each  k,  since  x*"  g  M(;'''),  f^x"")  >  ;/  ^  By  the  continuity  off,  this  impHes  that 

%*)  >  r*.  Since  x*  e  M(x  *),  we  also  have  that  f(x*)  >  y*.  Since  f,  i  =1,  2,  . . .,  p,  are 
strongly  quasiconcave  and  y*  ^  x*,  it  follows  that  f(Ax*  +  (l-;i)y*)  >  min  {f(x*), 
f(y*)}>  y  *  for  any  A  such  that  0  <  A  <  1.  By  choosing  A  =  0.6,  we  obtain  that  f(0,6x*  + 
0.4y*)  >  y*.  Since  y^  -^  y*  when  k  ->  x,  there  exists  a  positive  integer  K2  such  that 
f(0.6x*  +  0.4y*)  >  ;k''  when  k  >  K2.  That  imphes  that  0.6x*  +  0.4y*  g  M(;''')  when  k  > 
K2.  Therefore, 
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II  (0.6x*  +  0.4y*  )  -  X*  II  >  min  {||x  -  x*||  |  x  e  M(x '')} 

=  l|x''-x*|| 
for  all  k  >  K2.  This  implies  that 

0.4  ||y*  -x*||>||x''-x*||  (3.11) 

for  all  k> K2. 

From  (3.10)  and  (3.1 1),  it  follows  that 

0.4  ||y*  -  x*||  >  II  x''  -  x*||  >  0.5  ||y*  -  x*|| 
for  all  k  >  max  {Ki,  K2}.  This  is  a  contradiction.  Therefore  y*  =  x*  must  hold.  By  the 
choice  of  y*,  we  have  proven  that  x""  -^  x*  when  k  -^  oc.  Thus,  M(;')  is  lower 

semicontinuous  at  ^  *• 

(c)  Since  f  is  a  linear  vector-valued  function  and  X  is  a  polytope,  we  may  assume 
that  f(x)  =  Cx  and  X  =  (x  e  R"|  Ax  <  b,  x  >  0},  where  C  is  a  p  x  n  matrix,  A  is  a  m  x  n 
matrix  and  b  e  R'".  Similarly  to  (b),  we  only  need  to  prove  the  point-to-set  map  y  -^ 
]yi(^)  =  |x  e  X|  Cx  >  p' }  is  lower  semicontinuous  at  any  given  point  /*  in  E!'  with 

M(x*)^0. 

Suppose  that  ^  *  e  R^  and  M(/  *)  ;^  0.  Suppose  that  {y^}  <^G'=  {r\  M(r )  ^ 
0j^  y^  ^  y*  v/hen  k  ^  oc,  and  x*  e  M(y  *).  Since  X  is  a  compact  set,  M{y^)  is  a 
nonempty  compact  set.  Therefore,  we  may  choose  x''  e  M(/'')  for  each  k  such  that  x  is 

an  optimal  solution  of  the  problem  (Q)  given  by 

min(l/2)||x-x*||^ 
s.t.  Cx  >  X  \  Ax  <  b,  X  >  0. 
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Problem  (Q)  is  a  convex  quadratic  programming  problem.  By  using  the  Karush- 
Kuhn-Tucker  conditions,  we  see  that  x''  is  an  optimal  solution  if  and  only  if  x''  is  a  feasible 
solution  and  there  exists  a  vector  u  e  rp"^*""^"  such  that 


T     aT 


x''-x*  +  [-C',  A',-I]u-0, 


(uf 


Cx'-x' 
b-Ax" 

..k 


(3.12) 


(3.13) 


u>0,  (3.14) 

where  I  is  the  n  x  n  identity  matrix.  In  Lemma  3.2. 1,  let  D  =  [-C\  A"^,  -I],  v*  -  x*  -  x\  y* 
=  [(Cx''  -  ;''')'^,  (b  -  AxV,  (x'')^]^,  and  M  =  max  {||B"'||  |  B  is  a  nonsingular  submatrix  of 
D}.  By  Lemma  3.2.1,  for  each  k  -  1,  2,...,  there  exists  a  vector  u''  that  satisfies  (3.12)- 
(3.14)  such  that  i|u''||  <  M||x'' -  x*||. 

Since  (x''}  c  X,  and  X  is  compact,  {x''}  has  convergent  subsequence.  Without  loss 
of  generality,  we  may  assume  that  (x''}  is  a  subsequence  convergent  to  a  vector  z*.  Since 
x''  G  M(/ '')  for  each  k,  z*  g  M(/  *).  Notice  that  M  is  a  fixed  number  and  ||u''||  <  M||x''  - 
x*||  for  each  k.  Therefore,  {u''}  is  bounded.  This  implies  that  {u''}  has  at  least  one  cluster 
point.  Let  u*  be  a  cluster  point  of  {u''}.  Then,  fi-om  (3.12)-(3.14),  letting  k  -^  cc,  we 

obtain 

z*  -  X*  +  [-C^,  A^,  -I]u*  =  0, 


(u*)' 


Cz*-r* 

b-Az* 


=  0, 


u*  >0. 


This  implies  that  z*  is  an  optimal  solution  of  the  problem 
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min  (l/2)|lx  -  x*||^ 
s.t.  X  G  M{y*). 

Since  x*  g  M(/  *),  the  above  problem  has  the  unique  optimal  solution  x*.  Therefore,  z* 


Summarizing,  we  have  found  a  sequence  {x''}  such  that  x''  eM{r^)  for  each  k  and 
x*^  _>  X*.  Thus,  M(/ )  is  lower  semicontinuous  at  y  *.  By  the  choice  of  y  *,  the  proof  is 

complete.  '-' 

Remark  3.2.1.  It  is  well  known  that  a  linear  real-valued  function  need  not  be 

strongly  quasiconcave  and  a  strongly  quasiconcave  real-valued  function  need  not  be  linear. 

Therefore,  the  converses  of  Theorem  3.2.4  (b)  and  Theorem  3.2.4  (c)  are  not  true. 

Let  f  =  (fi,...,fp)^  be  a  p-dimensional  continuous  vector-valued  flinction  defined  on 

the  compact,  convex  set  X.  Then,  from  the  above  results,  we  have  the  following 

relationships  shown  in  Figure  3.1. 


Evety  component  function 
of  f  is  strongly 
quasiconcave  on  X 


Every  component 
ftinctionoff  is  linear 
and  X  is  a  pol>1ope 


V    V 


f  is  strictly 
quasiconcave  on  X 


,^--5 


Every  component 
fiinction  of  f  is  strictly 
quasiconcave  on  X 


f  is  quasi- 
concave on  X 


Ever)'  component 
fiinction  of  f  is 
quasiconcave  on  X 


Figure  3.1 
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3.3.  Parametric  Representations  of  the  Efficient  Set 

In  this  section,  we  will  present  some  new  results  that  characterize  the  efficient 
solutions  of  a  p-dimensional  MOMP  problem.  These  characterizations  are  in  terms  of  the 
optimal  solutions  of  appropriate  parametric  scalar  optimization  problems  or  in  terms  of 
efficient  solutions  of  appropriate  (p-l)-dimensional  parametric  MOMP  problems. 

First,  we  present  a  new  result  that  characterizes  the  efficient  solutions  of  a  MOMP 
problem  in  term  of  the  optimal  solutions  of  appropriate  parametric  scalar  optimization 
problems.  As  we  mentioned  in  Section  2.1,  one  of  the  commonly  used  scalar  optimization 
problems  is  the  "ith-objective,  e-constraint  problem",  which  can  be  defined  as 

Pi(s):       max  fi(x) 

S.t.  X  G  X(i)(  s), 

where  is  { 1 ,  2, . . .  ,p }  and  8  e  R""'.  Let  us  define  the  set  of  all  optimal  solutions  of  problem 

Pi(8)byX(,(f). 

From  Theorem  4. 1  of  Chankong  and  Haimes  (1983),  we  know  that  x*  g  E(f,  X)  if 
and  only  if  x*  is  an  optimal  solution  of  Pi(8*)  for  every  i  =  1,  ...,p,  where  8*  =  f(i)(x*).  The 
following  theorem  extends  this  result.  ....  . 

Theorem  3.3.1.  Let  X  c  R"  be  nonempty,  and  let  f  =  (fi,...,fpf  be  a  p-dimensional 
vector-valued  function  defined  on  X.  Then,  x*  g  E(f,  X)  if  and  only  if  for  every  i  =  1,  ..., 
p,  there  is  e'  g  f(i)(X)  such  that  x*  is  an  optimal  solution  of  Pi(£' ),  i.e. 

E(f,X)=nU(^,^(^)l^^fc.)W)- 

1=1 

Proof  By  Theorem  4. 1  of  Chankong  and  Haimes  (1983), 
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p 

r 

i=l 


E(f.X)cnU{X(,(£)kef„(X)}. 


Now,  we  prove  the  reverse  inclusion    Let  x*    g    flU^-^co^^)  l^^^coW)- 

Suppose  to  the  contrary  that  x*  g  E(f,  X).  Then,  there  is  x  e  X  such  that 

fl[x)  >  f(x*),  and  f(x)  ;>^  f(x*).  (315) 

Without  loss  of  generality,  suppose  that  fi(x)  >  fi(x*).  Now,  we  claim  that 

Otherwise,  suppose x*  g  X(,)(^*)  for  some  e*Gf(,)(X).  Since x*  g  X(,) (f *) ,  we  have 

f(i)(x*)>£*.  (3  16) 

By  (3.15)  and  (3.16),  f(i)(x)  >  f(i)(x*)  >  s*.  This  together  with  x  g  X  yields  x  g 
X(,)(f*) .  By  our  assumption  that  fi(x)  >  f,(x*),  we  have  x*  i  X(,)(^*)  This  contradicts 
our  assumption  that  X*  g  X^.^C^-*).  Thus,  x*  g  U{X(,)(£)|£Gf(,)(X)}.  This  contradicts 

x*enU(X(o(^)l^ef,)(X)}. 


i=l 


Therefore,  flU^^wC^)  k  ef(,)(X)}Q  E(f,  X).  D 


i=l 


Next  we  present  a  new  result  that  characterizes  the  efficient  solutions  of  an 
MOMP  problem  with  p  objective  functions  in  terms  of  efficient  solutions  of  some 
particular  MOMP  problems  with  p-1  objective  functions. 

Sun    (1996)    introduced   the   following   (p-l)-dimensional    parametric   MOMP 

problem 


P(i)(t):      v-max  f(,)(x) 

S.t.  X  G  Xi(t), 

where  i  e  {1,  2,...,p},  t  e  RV  The  efficient  decision  set  and  the  efficient  outcome  set  of 
problem  P(o(t)  are  denoted  by  E(f(i),  X,(t))  and  E(f(,)(  Xi(t)),  R^'),  respectively.  When  p  = 
2,  problem  P(i)(t)  is  a  scalar  optimization  problem.  For  convenience,  we  still  use  E(f(i), 
Xi(t))  and  E(f(i)(  Xi(t)),  R";')  to  present  the  optimal  solution  set  and  optimal  value  set, 
respectively,  when  p  =  2.  Sun  (1996)  proved  the  following  result. 

Theorem  3.3.2.  Let  X  c  R"  be  a  nonempty  compact  convex  set,  and  let  f  = 
(fi,...,fp)^  be  a  p-dimensional  continuous  and  quasiconcave  vector-valued  function  defined 
on  X.  If  there  is  j  g  { 1,. .  .,p}  such  that  ^  is  strongly  quasiconcave  on  X,  then  x*  g  E(f,  X) 
if  and  only  if,  for  any  given  i  g  {l,...,p}\  {j},  there  is  t  g  [f,,f,]  such  that  x*  is  an 

efficient  solution  of  P(i)(t),  i.e.  .  ' 

E(f,X)  =  L.^{E(f(i),X,(t))|tG[f,,f,]} 

foranygivenie  (l,...,p}\(j}. 

In  the  following,  we  present  a  new  result  that  characterizes  an  efficient  solution  for 

a  general  MOMP  problem. 

Theorem  3 .3 .3 .  Let  X  c  R"  be  a  nonempty  compact  set,  and  let  f  =  (fi, . . . ,fp)  be  a 
p-dimensional  continuous  vector-valued  function  defined  on  the  compact  set  X.  Then,  x* 
e  E(f,  X)  if  and  only  if  for  every  i  =  1,  ...,  p  there  is  ti  g  [f,,fj  such  that  x*  is  an 
efficient  solution  of  P(i)(ti),  i.e. 

E(f.X)=nU(E(fo),X,(t))|tG[f,,f,]}. 
1= 

Proof  We  first  prove  that 


1=1 
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E(f,X)cnU{E(f(0'X,(t))|te[f,,f,]}.  (3.17) 

1=1 

Let  X*  e  E(f,  X).  Suppose  to  the  contrary  that 

x*grHJ{E(f(,)>X,(t))|te[f,,f,]}. 

1=1  ,    ' 

Then,  there  is  i  e  {!,...,?}  such  that  x*  ^  jJ^^^^W'^.W)!  ^  ^  [f,,f.]}  That  is,  for  any 
t  G  [f,,f,],  X*  g  E(f(i),  Xi(t)).  Take  t*  =  fi(x*).  Since  x*  €  E(f(i),  X,(t*)),  there  is  x  e 
X,(t*)  such  that  f(i)(x)  >  f(i)(x*),  f(i)(x)  ^  f(i)(x*),  and  fi(x)  >  t*  =  fi(x*).  Thus,  we  have 
found  a  x  G  X  such  that  f(x)  >  f(x*)  and  f(x)  ^  f(x*).  This  contradicts  x*  g  E(f,  X).  Thus, 
(3.17)  holds.  y 

Now,  we  prove  that 

hU(E(f(i),X,(t))|tG[f,,f,]}cE(f,X).  -    ,        (3.18) 

1=1 

Letx*  e  riU^E(fc)'X.W)|t  e  [f,,f,]}-  Suppose  to  the  contrary  that  x*  g  E(f, 

i=l 

X).  Then  there  exists  a  vector  x  e  X  such  that 

f(x)  >  f(x*)  and  f(x)  ^  f(x*).  (3.19) 

This  implies  that  there  exists  an  i  g  {1,  2,...,p}  such  that  f(i)(x)  >  f(i)(x*),  and  f(i)(x)  ^ 
f(i)(x*).  Without  loss  of  generality,  suppose  that  f(i)(x)  >  f(i)(x*),  and  f(i)(x)  ^  f(i)(x*). 

We  claim  that         :  /   '  .-.>./      '  ;  ,    j  ,  •        ' 

x*gU(E(fo).X.(t))|tG[f,,fJ}.  ,        (3.20) 

To  verify  (3.20),  suppose  that  x*  g  E(f(i),  Xi(t*))  for  some  t*  6  [f,,f,]}.  Since  x*  g 
Xi(t*), 


^.-vi^y    -      ■■.  ,  ■    .    ■  ,;..  ■     ^:.,  y. 
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f,(x*)>t*.  (3.21)        ,. 

By  (3.19)  and  (3.21),  fi(x)  >  fi(x*)  >  t*.  This  together  with  x  g  X  yields  x  e  Xi(t*).  Since 
f(i)(x)  >  f(i)(x*),  and  f(i)(x)  ^  f(i)(x*),  this  imphes  that  x*  g  E(f(i),  Xi(t*)).  This  contradicts 
our  assumption  that  x*  s  E(f(,),  X,(t*)).  Thus  (3.20)  must  hold. 

The    fact    that    (3.20)    is    true    contradicts    the    assumption    that    x*     g 

p||J{E(f(,),  X,(t))|  t  e  [f,  ,f,  ]}.  Therefore,  (3.18)  is  true,  and  the  proof  is  complete.     D 

1=1 

Next,  we  present  a  new  resuU  that  characterizes  the  efficient  solutions  of  a  p- 
dimensional  MOMP  problem  in  terms  of  the  optimal  solutions  of  problem  Pi(s),  where  e  is 
an  efficient  outcome  of  the  (p-l)-dimensional  MOMP  problem  P(i)(t)  for  some  t  g  [f; ,?;  ]. 

Theorem  3.3.4.  Let  X  c  R"  be  a  nonempty  compact  set,  and  let  f  =  (fi, . . .  ,fp)  be  a 
p-dimensional  continuous  vector- valued  function  defined  on  X.  Assume  that  ie{l,...,p}. 
Then,  x*  g  E(f,  X)  if  and  only  if  there  is  an  efficient  outcome  e  of  problem  P(i)(t)  for 
some  t  G  [f. ,  f,  ]  such  that  x*  is  an  optimal  solution  of  problem  ?!(£■),  i.e. 

E(f,X)  =  u{X(,)(f)|f  gF}  (3.22) 

where  F  =  u  {  E(f«(  X,(t)),  R:')  1 1  g  [t,l  ]}. 

Proof  We  first  prove  that 

E(f,X)cu{X(,^(f)|f  gF}.  (3.23) 

Suppose  that  x*  g  E(f,  X).  Set  t  =  fi(x*)  and  e  =  f(i)(x*).  Then  x*  g  X(i)(f )  and 
e  G  f;i)(X,(t)).  ,.  •     :--'        .'-/X 

Suppose  that  £  i  E(f(i)(  Xi(t)),  R^' ).  Then  there  exists  x  g  Xi(t)  such  that 


a: 


•  _jf'i 
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f(i)(x)  >£=  f(i)(x*)  and  f(i)(x)  ^  f(i)(x*).  (3.24) 

Since  x  g  Xi(t),  it  follows  that 

fi(x)  >  t  =  fi(x*).  (3.25) 

From  (3.24)  and  (3.25),  we  obtain  that 

f(x)  >  f(x*)  and  f(x)  ;t  f(x*). 
This  contradicts  that  x*  e  E(f,  X).  Therefore  e  e  E(f;i)(  Xi(t)),  R:' )  c  F. 

Now  suppose  that  x*  g  X(,)(£:) .  Then  there  exists  a  vector  x'  e  X(,^(£')  such  that 

fi(x')  >  fi(x*).  (3.26) 

Since  x' e  X(i)(£:),  it  follows  that 

f(i)(x')  >  ^  =  f(,)(x*).  ■■  ■■     _  (3.27) 

By  (3.26)  and  (3.27),  we  have  that  f(x')  >  f(x*)  and  f(x')  ^  f(x*).  This  contradicts  that  x* 
eE(f,X).  Hence,  X*  gX(,)(£).  '■         . 

Since  fsF  and  X*  eX(,)(£),  (3.23)  holds.  - 

■  a"       ' 

We  now  demonstrate  the  inclusion  opposite  to  (3.23).  Let  t  e  [f,  ,f,  ],  e  g 
E(f(i)(Xi(t)),  RP"'),  and  x*  &X^^{£).  Since  e  g  f(i)(Xi(t)),  we  may  choose  an  x  g  Xi(t) 
such  that  f(i)(x)  =  £ .  Thus,  x  g  Xf^^(£).  This  together  with  x*  GX(,)(f)and  x  e  Xi(t) 

yields  that 

f.(x*)  >  fi(x)  >  t.  (3.28) 

'  ■■  Suppose  that  x*  g  E(f,  X).  Then  there  exists  a  vector  x'  g  X  such  that 

f(x')  >  f(x*)  and  f(x')  ^  f(x*).  (3.29) 

By  (3.28)  and  (3.29),  since  x*  g  X^^(£),  we  have  that 
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fi(x')  >  fi(x*)  >  t,  f(i)(x')  >  f(i)(x*)  >  s  (3.30) 

Since  s  &  E(^i)(Xi(t)),  R^' ),  it  follows  from  (3.30)  that 

f(0(x')  =  f(i)(x*)  =  f  .  (3.31) 

Thus,  by  (3.29),  fi(x')  >  fi(x*).  From  (3.31),  since  x'  g  X,  this  contradicts  that  x*  6 
X(.)(f ) .  Therefore,  x*  g  E(f,  X),  and  we  have  proved  the  opposite  inclusion  to  (3.23).  D 
Theorem  3.3.5.  Let  X  e  R"  be  a  nonempty  compact  set,  and  let  f  =  (fi,. .  .,fp)^  be  a 
p-dimensional  continuous  vector-valued  flinction  defined  on  X.  Assume  that  i  g{1,...,  p}. 
If  there  exist  at*  g  [f,,f,]  and  an  6.-*  g  f(i)(X)  such  that  x*  g   X(,j(f*)and  e*  g 

E(f(i)(X(t*)),  Rr' ),  then  f(i)(x*)  =  e*. 

Proof  Since  e*  e  E(f(i)(Xi(t*)),  R^'),  there  exists  an  x  g  Xi(t*)  such  that  f(i)(x)  = 
s*.  Therefore,  x  g  X(,)(£*)  .  Since  x*  g  X^^is*) and  x  g  Xi(t*),  this  implies  that 

f;(x*)>f;(x)>t*. 

Therefore,  x*  e  Xi(t*).  Since  x*  g  X,  this  implies  that  f(i)(x*)  e  f(i)(Xi(t*)). 
Suppose  that  f(i)(x*)  ^^  *.  It  follows  fi-om  x*  g  X(,)(f*)that 

f(i)(x*)>^*. 

Thus,  we  have  found  a  vector  f(i)(x*)  g  f(i)(Xi(t*))  such  that  f(i)(x*)  ;tf  *  and  f(i)(x*)  >  e*. 
This  contradicts  thatf  *  g  E(f(.)(X.(t*)),  R^' )■  Consequently,  f(i)(x*)  =  e*.  □ 

X .   !    .i,  .»:     .  ...-     ,'      ^   ■ ..-:  .'      ■■     u    t  •,..  - 

f':  ■      ■     ■ 
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3.4.  The  Closedness  of  E(f,  X)  for  General  MOMP  Problems 

We  now  are  in  a  position  to  focus  on  our  main  topic  in  this  chapter:  Conditions  for 
the  closedness  of  the  efficient  solution  set  E(f,X)  of  problem  MOMP.  We  first  present  a 
necessary  condition  for  E(f,  X)  to  be  closed. 

Theorem  3 .4. 1 .  Let  X  e  R"  be  a  nonempty  compact  set,  and  let  f  =  (fi, . . .  ,fp)^  be  a 
p-dimensional  continuous  vector-valued  flinction  defined  on  X.  If  E(f,X)  is  closed,  then 
for  any  ie  { l,...,p},  the  point-to-set  map  s  ->    X(,)(£)  is  upper  semicontinuous  on  F  =  ^ 

(E(f(0(X,(t)).  Rr')|te[f,,f,]}. 

Proof  Let  (f ''}  c  F,  £  G  F,  ^""-^  f,  x''  g  %^{£^),  and  x''->  x  To  complete 
the  proof,  we  need  to  show  that  x  g  X(,)(f).  From  Theorem  3.3.4,  for  each  k,  we  have 

■  ■         € 

that  x''  G  E(f,  X).  Since  E(f,  X)  is  closed  and  x''^  x,  this  implies  that  x  g  E(f,  X), 
Furthermore,  from  Theorem  3.3,5,  for  each  k  we  have  that  f(i)(x'')  =  e^.  Since  f  is 
continuous,  this  implies  that  f(i)(x)  =  e  .  Therefore,  x  g  X(i)(e  )• 

Suppose,  to  the  contrary,  that  x  g  X(,)(6-).  Then,  there  exists  x'  g  X(i)(£-)  such 
that  fi(x')  >  fi(x).  Since  x'  g  X(i)(f )  and  f(i)(x)  =  f,  f(i)(x')  >  f(i)(x).  Because  fi(x')  >  fi(x), 
this  implies  that  f(x')  >  f(x)  and  fi(x')  >  fi(x).  This  contradicts  xg  E(f,X),  so  that  the  proof 

is  complete.  ^ 

By  adding  an  additional  condition  to  the  necessary  condition  in  Theorem  3.4.1,  we 

obtain  the  sufficient  conditions  given  in  the  next  resuh  for  E(f,  X)  to  be  closed. 

Theorem  3.4.2.  Let  X  e  R"  be  a  nonempty  compact  set,  and  let  f  =  (fi,. . .,fp)^  be  a 

p-dimensional  continuous  vector-valued  flinction  defined  on  X.   If  there  is  an  i   g 
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{l,...,p}such  that  the  point-to-set  map  s  -^  ^^^(s)  is  upper  semicontinuous  on  F  =  u 
{E(f(i)(  Xi(t)),  R^"')|  t  G  [f,,f,]},  and  such  that  the  point-to-set  map  t  ^  E(f(.)(X,(t)), 
RP"' )  is  upper  semicontinuous  on  [  f , ,  f,  ],  then  E(f,  X)  is  closed. 

Proof.  Let  {x"}  be  a  sequence  of  vectors  in  E(f,  X)  such  that  x"  ->  x*  as  n  ^  x. 
We  need  to  show  that  x*  g  E(f,  X).  For  each  n,  since  x"  g  E(f,  X),  it  follows  from 
Theorem  3.3.4  that  if  we  choose  i  as  stated  in  the  theorem,  then  there  exist  t"  g  [f,  ,f,  ] 
and  f "  G  E(f(i)(Xi(t")),  RP"')  such  that  x"  e  X^^(s").  Since  (t")  and  { f"}  are  bounded,  it 
follows  that  they  have  convergent  subsequences.  Without  loss  of  generality,  assume  that 
{t"}  and  {s"}  are  two  convergent  subsequences  with  t"  ->  t*  and  f"  ->  f  *.  Since  the 
point-to-set  map  t  ->  E(f(i)(Xi(t)),  R^' )  is  upper  semicontinuous  on  [  f; ,  f,  ],  it  follows  that 

f*GE(f(.)(Xi(t*)),  Rr')cF.  (3.32) 

Since  the  point-to-set  map  e  -^  %i)ie)  is  upper  semicontinuous  on  F,  it  also  follows  that 

X*  G  X„(£*)  (3.33) 

By  (3.32),  (3.33)  and  Theorem  3.3.4,  x*  g  E(f,  X).  □ 

One  may  notice  that,  in  practice,  it  is  generally  quite  difficult  to  verify  the 
conditions  in  Theorem  3.4.2  for  a  given  MOMP  problem.  This  may  suggest  that  Theorem 
3.4.2  be  of  little  practical  use.  However,  as  we  will  see  in  the  next  section.  Theorem  3.4.2 
can  be  used  to  develop  some  other  more  practical  sufficient  conditions. 

In  the  following,  we  will  present  some  sufficient  conditions  for  E(f,  X)  to  be  closed 
under  some  generalized  convexity  assumptions  on  f 
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Theorem  3.4.3.  Let  X  c  R"  be  a  nonempty,  compact  convex  set,  and  let  f  = 
(fi,...,fp)^  be  a  p-dimensional,  continuous,  vector-valued  function  defined  on  X.  If  the 
vector-valued  function  f  is  strictly  quasiconcave  on  X,  then  E(f,  X)  is  closed. 

Proof.  By  Theorem  3 . 3 . 1 ,  we  have  that 

E(f.X)=nU(^(.)(^)l^ef(.)W} 

i=l 

To  prove  that  E(f,  X)  is  closed,  we  need  only  to  prove  that  U{X(,3(£)|£Gf(,)(X)}is 

closed  for  every  i=  1,..., p.  ' 

Let  i  e  (1,  2,...,p},  {x"}  e  [j{X,^(£)\sGf^,iX)}  and  x"  ^  x*  when  k  ^  x. 

Then,  there  exist  e^  g  f(,)(X)  such  that  x""  e  X(„(£')for  k  =  1,  2,....  Since  (f" }  C 

f(i)(X),  and  f(i)(X)  is  bounded,  {f'' }  has  at  least  one  convergent  subsequence.  Without 

loss  of  generality,  assume  that  {s^}  is  an  arbitrary  convergent  subsequence,  and  that 

e"  ^e  * .  Since  f(,)(X)  is  closed  and  { f ' }  ^  f(,)(X).  ^  *  ^  f(.)(^)  ■  ^°^  ^^^^  ^^  ^"^^^^  ^^ 

G  X(,)(£'),  we  know  that  x"  e   X^.^C^"),  i.e.  f(,)(x'')>  e\  By  continuity  of  fjo,  this 

implies  that  f(i)(x*)  >  £:*,  i.e.  x*  e  X(,j(£*). 

Suppose  that  X*  g  X(,)(£*).  Then  there  exists  y*  e  X^^(£*)  such  that 

f.(y*)  >  f,(x*)  (3  34) 

Since  f  is  strictly  quasiconcave  on  X,  it  follows  from  Theorem  3.2.3  that  f(i)  is  also  strictly 
quasiconcave    on    X.    By    Definition    3.2.3,    this    implies    that    X^,y{e)    is    a    lower 

semicontinuous  map  on  {£|  X^,^{£)  ^  0}.  Therefore,  since  y*eX^,^{e*),  X^^(e)  is 
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lower  semicontinuous  at  f  * .  Hence,  there  exists  {/}  such  that  /  g  X(.)(£'')  for  k  large 

enough,  and  such  that 

y'' ->  y*  when  k  ^^  00.  (3  35) 

It  follows  from  (3.34),  (3.35)  and  x''  ->  x*  that 

f,(y'')>f,(x'') 

when  k  large  enough.  This  contradicts  that  x''  g  X^^^ie^) for  all  k  =  1,  2,. . . .  Therefore,  x* 

G  X„(f*)  .  Consequently,  E(f,  X)  is  closed.  Q 

Theorem  3.4.4.  Let  X  c  R"  be  a  nonempty  compact  convex  set,  and  let  f  = 
(fi,...,fp)^  be  a  p-dimensional,  continuous,  vector- valued  function  defined  on  X.  If  each 
function  f,  i  =  l,...,p,  is  strongly  quasiconcave  on  X,  then  E(f,  X)  is  closed. 

Proof  .  This  result  follows  immediately  from  Theorem  3.2.4  (b)  and  Theorem 

3.4.3.  ° 

A  different  result  related  to  Theorem  3.4.4  is  given  in  Theorem  4.1.11(i)  of  Luc 

(1989). 

Theorem  3.4.5.  Let  X  c  R"  be  a  nonempty  compact  convex  set,  and  let  f  = 
(fi,...,fp)^  be  a  p-dimensional  continuous  quasiconcave  vector-valued  function  defined  on 
X.  If  there  exists  at  least  one  iG{l,  ...,  p}  such  that  fi  is  strongly  quasiconcave  on  X  and 
the  optimal  solution  set  map  X^^is)  of  problem  Pi(^)  is  upper  semicontinuous  on  f(i)(X), 

then  E(f,  X)  is  closed. 

Proof  Let  {x''}e  E(f,  X)  and  x''  ->  x*.  Choose  i  as  in  the  statement  of  the 
theorem.  Since  f  is  continuous  and  quasiconcave  on  X,  and  fi  is  strongly  quasiconcave  on 
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X,  Theorem  3.1  of  Sun  (1996)  implies  that  for  each  k  there  exists  a  vector f''  g  f(,)(X) 
such  that  x''  €  X(,(f " ) .  Since  { e'  }c  f(,(X) ,  and  f(,(X)  is  bounded,  { e'  ]  has  at  least 
one  convergent  subsequence.  Without  loss  of  generality,   assume  that      {s^}   is  a 
convergent  subsequence  and  ^'^  £*  as  k  ^   oo.  Then  e*  e  f(,)(X),  since  f(,)(X)  is 

closed.  Since  the  point-to-set  map  s  -^  %)(s)  is  upper  semicontinuous  on  f(i)(X),  we 
have  that  x*  g  X(,)(^*)  ■  Since  f  is  continuous  and  quasiconcave  on  X,  and  fi  is  strongly 
quasiconcave  on  X,  from  Theorem  3.1  of  Sun  (1996),  x*  g  E(f,X).  Consequently,  E(f,X) 

is  closed. 

Theorem  3.4.6.  Let  X  c  R"  be  a  nonempty  compact  convex  set,  and  let  f  = 
(fi,...,fp)^  be  a  p-dimensional  continuous  quasiconcave  vector-valued  function  defined  on 
X.  If  there  exists  at  least  one  Ig  { l,...,p}  such  that  fi  is  strongly  quasiconcave  on  X  and  the 
point-to-set  map  s  ^  X^^ie)  is  lower  semicontinuous  on  fli)(X),  then  E(f,  X)  is  closed. 

Proof  By  Theorem  3.4.5,  we  only  need  to  prove  that  the  point-to-set  map  from  e 
to  the  optimal  solution  set  X„(f)  of  problem  Pi(e)  is  upper  semicontinuous  on  f(i)(X). 
Let  {s'}Q  f(,)(X),  e  *  g  f(i)(X),  ^ ^  -^  ^  * ,  x'  g  X^^ie') ,  x'' ^  x*.  Since,  for  each  k,  x" 
G  X^^ie'),  we  have  x"  g   X^^(e'),  i.e.  f„(x'')>  s' .  By  continuity  of  f  on  X,  this 
implies  that  f(,)(x*)  >£*,  i.e.  x*  g  X^^{£*) 

Suppose  that  x*  i  X^^  (s*) .  Then  there  exists  a  point  y*  g  X^.^  (e*)  such  that 

f,(y*)  >  f,(x*).  (3  36) 
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Since  X(^^(e)  is  lower  semicontinuous  at  £•  * ,  there  exists  a  sequence  (y''}  such  that  for  k 
large  enough,  /  e  X(i)  (f" ) ,  and  such  that 

y'' ->  y*  as  k ->  00.  (3.37) 

It  follows  from  (3.36),  (3.37)  and  x''  -^  x*  that  there  exists  an  integer  k  of  sufficient 
magnitude  such  that 

f,(y')>f.(x^)- 

Since  y''  g  X^,^{e^)  for  k  sufficiently  large,  this  contradicts  that  x  e  X^^{e  )  for  all  k  =  1, 
2,....  Therefore,  x*  e  X„(f*).  Hence,  the  point-to-set  map  e  -^  X(,)(f)  is  upper 
semicontinuous  on  f(i)(X).  ^ 

3.5.  The  Closedness  of  E(f,  X)  for  Bicriteria  Programming  Problems 

In  this  section  we  consider  the  closedness  of  E(f,  X)  for  the  special  case  when  p=2. 

Theorem  3.5.1.  Let  X  c  R"  be  a  nonempty  compact  set,  and  let  f  =  (fi,  f2)  be  a 
two-dimensional  continuous  vector-valued  function  defined  on  X.  If  every  local  maximum 
solution  of  fi  in  X  is  also  a  global  maximum  solution  off  on  X  for  i  =  1,  2,  then  E(f,  X)  is 

closed. 

Proof  Since  every  local  maximum  solution  of  f  (i  =  1,  2)  in  X  is  also  a  global 
maximum  solution  of  fi  on  X,  it  follows  from  Theorem  3.3  of  Zang  and  Avriel  (1975)  that 
the  point-to-set  map  t  ->  Xi(t)  is  lower  semicontinuous  on  [f,  ,f,],  and  the  point-to-set 
map  e  ->  X2(£: )  is  lower  semicontinuous  on  [f  ^  ,^2].  To  establish  the  theorem,  we  will 
use  these  two  results  and  Theorem  3.4.2.  Thus,  it  is  sufficient  to  show  that  the  point-to-set 


.^•a. 
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map  s  ->  X(,)(e)  is  upper  semicontinuous  on  [ijJil  and  that  the  point-to-set  map  t 


-^ 


E(f2(Xi(t)),  R!^  )  is  upper  semicontinuous  on  [f, ,  f,  ]. 

We  first  prove  that  the  point-to-set  map  t  ->  E(f2(Xi(t)),  R'J  is  upper 
semicontinuous  on  [f , ,  f,  ].  Suppose  that  t*  g  [ f , ,  f, ],  that  {t'}  c  [f , , f,  ]  satisfies  t'  -> 
t*  as  k  ->  00,  that  y'  g  E(UMi%  K )  for  each  k,  and  that  y*^  ^  y*  as  k  ^  oo.  Since  / 
e  f2(Xi(t'')),  it  follows  that  there  exists  x"*  g  Xi(t'')  such  that 

y'^=f2(x'')andf.(x'')>t^  (3.38) 

Since  {x''}  is  bounded,  it  follows  that  it  has  at  least  one  convergent  subsequence.  Without 
loss  of  generality,  assume  that  {x''}  is  a  convergent  subsequence  and  that  x""  -^  x*  g  X  for 
some  X*.  Then,  by  continuity  of  f, 

y*  =  f2(x*)  and  f,(x*)  >  t*.  .  "  (3.39) 

Hence,  y*  G  f2(X,(t*)).  ' 

Suppose  that  y*  g  E(f2(Xi(t*)),  K\ ).  Then  there  exists  a  vector  x'  g  Xi(t*)  such 

that 

f2(x')  >  y*  =  f2(x*).  (3-40) 

It  follows  fi-om  the  lower  semicontinuity  of  the  point-to-set  map  t  -^  Xi(t)  at  t*  g  [f ,  ,f,  ] 

that  there  exist  {z""}  c  X  such  that  z^  GXi(t'')  for  k  large  enough,  and 

z*" ->  x' when  k -^  00.  (3-41) 

By  (3.38),  (3.40),  (3.41)  and  x''^  X*,  we  have  that 

f2(z'=)>f2(x'')  =  /  /•         '  (3.42) 
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when  k  large  enough.  Notice  further  that  -t  e  Xi(t'')  for  each  k  large  enough.  This 
together  with  (3.42)  contradicts  that  y'  e  E(f2(X,(t')),  R^)  for  each  k.  Therefore,  y*  g 
E(f2(Xi(t*)),  R'J.  Hence,  the  point-to-set  map  t  -^  E(f2(Xi(t)),  R^)  is  upper 
semicontinuous  on  [  f  I ,  f,  ]. 

Similarly,  we  can  also  prove  that  the  point-to-set  map  e  -^  X(,)(£)  is  upper 

semicontinuous  on  [  f  2 ,  f  2  ]  ■  " 

Consequently,  we  have  that  E(f,  X)  is  closed.  D 

Remark  3.5.1.  In  Schaible  (1983),  Schaible  proved  that  the  efficient  solution  set 
E(f,  X)  is  closed  if  X  is  compact  and  convex  and  fi  is  continuous  and  strictly  quasiconcave 
on  X  for  each  i  =  1,  2.  However,  we  do  not  require  any  convexity  assumptions  on  X  in 
Theorem  3.4.6.  Therefore,  Theorem  3.5.1  extends  the  result  of  Schaible  (1983)  to  cases 
where  f  need  not  possess  any  type  of  generalized  concavity  or  convexity  properties  and  X 
need  not  be  convex. 

Remark  3.5.2.  It  is  well  known  that  every  local  maximum  solution  of  a  continuous 
and  strictly  quasiconcave  function  on  a  convex  compact  set  is  a  global  maximum  solution. 
However,  we  can  easily  find  examples  to  show  that  a  continuous  function  may  not  be 
strictly  quasiconcave  even  though  each  of  its  local  maximum  solutions  is  also  a  global 
maximum  solution.  Therefore,  Theorem  3.5.1  extends  the  result  of  Schaible  (1983)  to  the 
cases  where  fi  may  not  be  strictly  quasiconcave  for  any  i  =  1,  2. 
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3.6.  Concluding  Remarks 

From  the  literature,  it  is  Icnown  that  the  efficient  decision  set  E(f,  X)  of  problem 
MOMP  is  generally  not  closed  when  p  >  3,  even  if  every  component  of  f  is  strictly 
quasiconcave  on  X  and  X  is  a  compact,  convex  set  (see,  e.g.,  Choo  and  Atkins  (1983)  and 
Steuer  (1986)),  It  is  also  well  known  that  the  efficient  decision  set  of  a  multiple  objective 
linear  programming  problem  is  closed.  This  leaves  open  the  question  of  whether  or  not, 
when  X  is  nonempty,  compact  and  convex,  there  exist  classes  of  vector-valued,  nonlinear 
functions  f  whose  components  are  not  all  strictly  quasiconcave  on  X  for  which  it  is 

guaranteed  that  E(f,  X)  is  closed.  .  .?  '      ' 

In  this  chapter,  we  have  answered  the  question  posed  above,  and  several  other 
questions  concerning  the  closedness  of  E(f,  X)  One  of  the  main  tools  that  we  used  to 
accomplish  this  was  to  introduce  the  new  notions  of  quasiconcavity  and  strict 
quasiconcavity  for  vector-valued  functions.  These  notions  are  direct  extensions  of  the 
definitions  of  quasiconcavity  and  strict  quasiconcavity  for  real-valued  flinctions. 

Using  these  two  new  definitions  and  some  other  results,  we  showed  that  E(f,  X)  is 
closed  when  f  is  a  continuous,  strictly  quasiconcave  vector-valued  ftinction  over  the 
nonempty,  compact  convex  set  X.  We  also  showed  that  if  each  component  of  f  is 
continuous  and  strongly  quasiconcave  on  the  nonempty,  compact  convex  set  X,  then  E(f, 
X)  is  closed.  We  went  on  to  show  several  other  necessary,  sufficient,  and  necessary  and 
sufficient  conditions  for  E(f,  X)  to  be  closed  For  instance,  in  the  bicriteria  case,  we 
extended  a  result  of  Schaible  (1983).  Our  new  result  gives  a  sufficient  condition  for  E(f, 
X)  to  be  closed  in  cases  where  f  is  continuous  and  X  is  nonempty  and  compact. 


CHAPTER  4 

FINDING  THE  SET  OF  ALL  EFFICIENT  EXTREME  POINTS 

FOR  PROBLEM  MOLP  IN  THE  OUTCOME  SPACE 


A  multiple  objective  linear  programming  problem  (MOLP)  can  be  written  as 

follows: 

MOLP:  v-max  Cx 
St.     Ax<b 
x>0, 

where  C  e  R^^",  A  e  R"'",  b  e  R"".  Then,  the  decision  set  X  for  problem  MOLP  is 

X={xGR"|Ax<b,x>0}, 
and  the  outcome  set  Y  for  problem  MOLP  is 

Y={Cx1xgX). 
Throughout  this  chapter  we  will  assume  that  X  is  a  compact  set.  It  follows  that  Y  is  also  a 
compact  set.  In  order  to  make  the  chapter  more  self-contained,  we  will  restate  some 
concepts  for  problem  MOLP. 

A  point  x''  G  R"  is  called  an  efficient  solution  for  problem  (MOLP)  when  x°  e  X 
and  there  exists  no  point  x  e  X  such  that  Cx  >  Cx°  and  Cx  ^  Cx".  Similarly,  a  point  y"  e 
RP  is  called  an  efficient  outcome  for  problem  (MOLP)  when  y°  g  Y  and  there  exists  no 
point  y  G  Y  such  that  y  >  y°  and  y  ;t  y^  The  set  of  all  efficient  solutions  and  the  set  of  all 
efficient  outcomes  for  (MOLP)  are  called  the  efficient  decision  set  and  the  efficient 


63 


64 

outcome  set,  respectively,  for  problem  MOLP,  and  are  denoted  by  Xe  and  Ye, 
respectively.  The  set  of  all  extreme  points  of  X  and  the  set  of  all  extreme  points  of  Y  are 
denoted  by  Xex  and  Yex,  respectively.  We  will  also  call  a  point  in  Xe  n  Xex  an  efficient 
extreme  point  in  decision  space,  and  a  point  in  Ye  n  Yex  an  efficient  extreme  point  in 

outcome  space. 

During   approximately   the   past   thirty   years,    various    algorithms   have   been 

developed  for  finding  the  set  Xr  r^  X^x,  or  the  entire  set  Xe.  Although  these  algorithms  are 

quite  different  in  certain  ways,  they  all  utilize  some  modified  version  of  the  simplex 

method.  One  general  difficulty  with  these  methods  is  that,  because  of  their  complexity  and 

the  complexity  of  Xe  and  Xe  n  Xx,  they  often  encounter  CPU  time  and  computer  storage 

■  limitations.  Most  of  the  computer  time  is  consumed  by  efficiency  tests  that  evaluate  the 

;/■     nonbasic  variables  at  each  basis  (see,  p.  245  of  Steuer  (1986)).  The  computer  storage 

limitations  arise  due  to  the  sheer  size  of  Xe  and  Xe  n  Xex  (Benson,  1998a).  Another 

general  difficulty  concerns  the  handling  of  degeneracy  (see  Section  2.3).  Apart  fi-om  these 

difficulties,  there  are  some  other  problems  related  to  these  methods.  For  example,  these 

methods  frequently  generate  a  set  so  large  that  it  overwhelms  the  DM  (see  e.g.  Benson, 

1998a).  Because  of  these  difficulties,  these  methods  have  achieved  only  limited  success  in 

practice. 

Recently,  some  researchers  have  begun  to  turn  their  attention  to  investigating  tools 
and  methods  for  generating  all  or  part  of  the  efficient  outcome  set  Ye,  (see  e.g.  Benson, 
1995a,  1997,  1998a,  1998b,  and  1998c;  Benson  and  Sayin,  1997;  Dauer,  1987,  1993; 
Dauer  and  Liu,  1990;  Dauer  and  Saleh,  1990;  Dauer  and  Gallagher,  1996).  This  is  in  part 
because  the  dimension  of  the  outcome  space  is  usually  much  smaller  than  the  dimension  of 
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the  decision  space.  Furthermore,  the  efficient  outcome  set  generally  has  a  much  simpler 
structure  than  the  efficient  decision  set.  Thus,  generating  all  or  part  of  the  efficient  set  in 
the  outcome  space  is  expected  to  be  more  practical  than  doing  so  in  the  decision  space. 

In  this  chapter,  we  will  present  a  weight  set  decomposition  algorithm  for 
generating  the  set  Ye  n  Yex.  The  approach  of  decomposing  the  weight  set  was  originally 
developed  by  Gal  and  Nedoma  to  deal  with  multiparametric  linear  programming  problems 
(see  Gal  and  Nedoma,  1972).  Later,  this  approach  was  adapted  by  Zeleny  for  use  in 
attempting  to  generate  the  set  Xe  o  X^x  (see  Zeleny,  1974). 

The  weight  set  decomposition  approach  involves  "decomposing"  the  weight  set  W^ 
=  {  w  =  (wi,  . . .  ,  Wp)^  I  Wj  >  0  for  all  j  =  1 , . . .  ,p  }  into  a  finite  number  of  subsets.  In  Zeleny 
(1974),  the  weight  set  W"  is  decomposed  into  a  finite  number  of  subsets  associated  with 
the  different  efficient  bases  in  the  decision  space  of  problem  MOLP  (the  definition  of  an 
efficient  basis  will  be  given  later  in  Section  4.1).  We  call  this  decomposition  the  decision 
set-based  decomposition  of  the  weight  set  W°. 

In  this  chapter,  we  will  decompose  the  weight  set  W*'  into  a  finite  number  of 
subsets  associated  with  the  different  efficient  extreme  points  in  the  outcome  space  of 
problem  MOLP,  rather  than  the  different  efficient  bases  in  the  decision  space  of  problem 
MOLP.  We  call  this  decomposition  the  outcome  set-based  decomposition  of  the  weight 
set  W^.  Unlike  the  decision  set-based  decomposition,  our  outcome  set-based 
decomposition  will  establish  a  one-to-one  correspondence  between  the  efficient  extreme 
points  in  the  outcome  set  and  subsets  of  W°.  Based  upon  this  decomposition,  we  will  then 
present  a  new  algorithm,  called  Basic  Weight  Set  Decomposition  Algorithm,  (BWSDA), 
for  generating  the  set  Ye  o  Y^x.     '      .■    ■.      ..  ^         - ,- ,'      A 
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The  algorithm  BWSDA  works  in  the  following  way:  At  each  iteration,  the 
algorithm  will  first  either  find  a  weight  vector  which  will  lead  to  an  unexplored  efficient 
extreme  point  in  the  outcome  space  or  conclude  that  all  points  in  Ye  o  Yex  have  been 
generated.  If  a  new  weight  vector  is  found  at  some  iteration,  the  algorithm  will  in  the  next 
iteration  call  for  solving  at  most  (p+1)  linear  programs  in  order  to  find  an  unexplored 
efficient  extreme  point  in  the  outcome  space. 

Two  different  kinds  of  approaches  will  be  developed  for  finding,  if  it  exists,  a  new 
weight  vector  in  each  iteration  that  leads  to  an  unexplored  extreme  point  in  the  outcome 
space.  One  approach  uses  a  tree  search  method.  The  other  calls  for  solving  a  special 
concave  minimization  problem  over  a  polyhedron.  These  two  different  approaches  yield 
two  versions  of  the  Basic  Weight  Set  Decomposition  Algorithm,  Weight  Set 
Decomposition  Algorithm-I  (WSDA-I)  and  Weight  Set  Decomposition  Algorithm-II 

(WSDA-II). 

This  chapter  is  organized  in  the  following  way.  In  Section  4.1,  we  will  review  the 
decision  set-based  decomposition  of  W*^  developed  by  Zeleny  (1974).  Our  outcome  set- 
based  decomposition  of  W"  will  be  given  in  Section  4.2.  The  new  algorithms  for 
generating  the  set  Ye  n  Yex  will  be  given  in  Section  4.3.  In  Section  4.4,  we  will  compare 
the  new  algorithms  with  Zeleny' s  decision  set-based  algorithm  (see  Zeleny,  1974)  and 
with  Benson's  outcome  set-based  algorithms  (see  Benson,  1998a,  c).  Section  4.5  gives 
some  conclusions. 
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4.1.  Decision  Set-Based  Decomposition  of  the  Weight  Set  W" 


As  stated  in  Section  2. 1,  one  common  strategy  for  dealing  with  problem  MOMP  is 

to  characterize  efficient  solutions  of  problem  MOMP  in  terms  of  optimal  solutions  of  the 

weighting  problem  P(w).  For  problem  MOLP,  we  use  LP(w)  to  denote  the  corresponding 

weighting  problem  P(w),  i.e.  LP(w)  is  given  by 

LP(w):     maxw  Cx 
s.t.  Ax  <  b 
x>0 

in  the  case  of  problem  MOLP  From  Theorem  2.6  in  Yu  and  Zeleny  (1975),  a  vector  x"  g 
R"  is  an  efficient  solution  of  problem  MOLP  if  and  only  if  there  exists  a  vector  w°  e  W° 
such  that  x°  is  an  optimal  solution  for  problem  LP(w°).  We  can  therefore,  in  theory,  find 
the  set  of  all  efficient  solutions  for  problem  MOLP  by  solving  problem  LP(w)  for  a 
properly  chosen  set  of  weights  in  W^. 

In  order  to  introduce  the  concept  of  an  efficient  basis  for  problem  MOLP  and  to 
show  relationships  between  efficient  bases  for  problem  MOLP  and  subsets  of  W°,  we  first 
transform  LP(w)  to  its  standard  form.  By  adding  slack  variables,  LP(w)  is  equivalent  to 
the  following  problem: 


LP(w)' :    max  w'  C 
s.t.    A 


.T 


vsy 


^x^ 


=  b. 


W 


^x^ 


vsy 


>0 


where  s  eR",  C  =  (C,  Op.  J,  and  A  =  (A,  !„,.„,). 
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Let  B  =  Bn,xm  be  a  nonsingular  submatrix  of  A ,  and  let  B'  denote  the  remaining 
submatrix.  B  is  called  a  basis  of  problem  LP(w)'.  If  the  basic  solution  determined  by  B  is 
also  an  optimal  solution,  then  B  is  called  an  optimal  basis  of  problem  LP(w)'.  If  there  is  a 
w  in  W°  such  that  B  is  an  optimal  basis  of  problem  LP(w)',  then  it  is  called  an  efficient 
basis  of  MOLP,  Let  Cg  be  the  submatrix  of  C  related  to  B,  and  let  Cg.  the  remaining 
submatrix.  The  simplex  tableau  T  of  LP(w)'  related  to  the  basis  B  is  of  the  form      • 


T  = 


^I     B'B'    B'b^ 


^0     w^Z     w^z^ 

where  Z  =  Cg  B"^B'  -  C^.  and  z  =  Cg  B''b.  Let  x(B)  denote  the  basic  solution  determined 
by  B.  If  B"^b  >  0,  then  x(B)  is  a  basic  feasible  solution.  In  this  case,  the  point  determined 
by  x(B)  is  an  extreme  point  of  X.  If  additionally  w'^Z  >  0,  then  the  basic  feasible  solution  is 
an  optimal  solution  for  problem  LP(w)'.  If  we  further  have  w  >  0,  then  the  basic  feasible 
solution  is  an  efficient  extreme  point  of  problem  MOLP  in  the  decision  space  and  the  basis 
B  is  an  efficient  basis. 

Let  W  =  {  w  =  (wi,  ...,  Wp)^  I  Wj  >  0  for  all  j  =  l,...,p  }.  For  any  given  efficient 
basis  B  for  problem  LP(w)',  consider  the  polyhedral  cone  W(B)  defined  in  Zeleny  (1974) 

by 

W(B)  =  {w|w'^Z>0}. 
From  Theorem  3.6  in  Yu  and  Zeleny  (1975),  there  exists  a  finite  number  of  efficient  bases, 
Bi,...,  Bq,  such  that 

Wc|JW(B,).  (4.1) 
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As  a  result,  W**  can  be  decomposed  into  a  finite  number  of  subsets  W**  n  W(Bi),  i=l,...,q 
such  that  for  each  x'  g  Xe  n  Xcx  there  exists  at  least  one  W(Bi),  i  e  { 1,. . .,q},  such  that  x' 
=  x(Bi)  and  x'  is  an  optimal  solution  of  problem  LP(w)'  for  any  w  in  W(Bi). 

We  will  call  the  decomposition  of  W°  which  is  based  upon  (4.1)  the  decision  set- 
based  decomposition  of  w  . 

The  weight  set  W°  can  also  be  decomposed  into  subsets  associated  with  different 
efficient  extreme  points  in  the  decision  space.  To  see  this,  for  a  given  point  x  in  X,  let 
W(x)  be  defined  by 

W(x)  =  { wgR""!  w^Cx  >  w'^Cx'  for  all  x'  in  X} .  (4.2) 

It  can  be  shown  that 

A  similar  result  can  be  found  on  p.  157  of  Chankong  and  Haimes  (1983).  As  a  result  of 
(4.3),  the  weight  set  W°  can  be  decomposed  into  a  union  of  subsets  W**  n  W(x),  x  e  Xe  n 

X«. 

Zeleny  (1974)  discussed  the  algorithmic  possibilities  and  strategies  for  locating  Xe 

n  Xex  by  using  decision  set-based  decompositions  of  W"  based  upon  (4.1)  or  (4.3). 
However,  as  noted  by  Zeleny  (1973,  1974),  there  are  some  difficulties  implementing 
algorithms  that  are  based  upon  either  of  these  decompositions.  Two  of  the  major 
difficulties  are  as  follows. 

The  first  difficulty  pertains  to  algorithms  that  might  decompose  W"  using  (4.1).  In 
this  approach,  a  difficulty  arise  due  to  the  fact  that  the  one-to-one  correspondence 
between  an  efficient  basis  B  and  the  subset  W(B)  may  be  destroyed  when  degeneracy 
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occurs.  When  x  is  a  nondegenerate  efficient  extreme  point,  there  is  only  one  efficient  basis 
B  associated  with  x.  In  this  case,  it  can  be  shown  that  W(x)=W(B).  When  x  is  a 
degenerate  efficient  extreme  point,  two  or  more  efficient  bases  can  correspond  to  x. 
Suppose  that  Bi,,..,Bi  are  the  distinct  efficient  bases  associated  with  x  Then,  it  can  be 
shown  that 

W(x)=UW(B.). 

i=l 

In  this  case,  there  is  a  possibility  that  each  W(Bi)  is  a  strict  subset  of  W(x),  and  that  W(Bi) 
i^  W(Bj)  for  any  given  two  different  bases  Bi  and  Bj  associated  with  x.  This  implies  that  in 
methods  that  use  a  decision  space-based  decomposition  of  W°  based  upon  (4.1),  all 
efficient  extreme  points  may  be  discovered  before  W"  is  fially  decomposed. 

The  second  difficulty  pertains  to  approaches  that  might  decompose  W°  based  upon 
(4.3).  This  difficulty  is  due  to  the  fact  that  there  need  not  be  a  one-to-one  correspondence 
between  the  efficient  extreme  points  x  and  the  sets  W(x).  Given  two  different  efficient 
extreme  points  x'  and  x',  there  is  a  possibility  that  W(x')  =  W(x').  This  would  imply  that  in 
some  cases,  we  may  fully  decompose  W'*  via  a  decision  set-based  decomposition  method 
based  upon  (4.3),  yet  all  efficient  extreme  points  may  not  be  found  thereby. 


4.2.  Outcome  Set-Based  Decomposition  of  the  Weight  Set  W" 


In  this  section,  we  will  present  an  outcome  set-based  decomposition  of  W.  We  will 
show  that  the  outcome  set-based  decomposition  approach  overcomes  the  difficulties  of 
the  decision  set-based  decomposition  approaches.  Some  useful  properties  of  the  outcome 
set-based  decomposition  are  also  given. 
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In  the  following,  we  will  first  introduce  some  definitions  and  notation.  All 
definitions  fi-om  convex  analysis  are  standard  and  may  be  found,  for  instance,  in 
Rockafellar(1970). 

Let  y  denote  a  point  in  Y.  Define  W(y)  by 

W(y)  =  {  weRP]  w\  >  w^y'  for  all  y'  in  Y  } .  (4.4) 

The  set  W(y)  is  called  the  normal  cone  to  Y  at  y  (see  Rockafellar  (1970)  for  example).  It 
is  easy  to  show  that  x  is  an  optimal  solution  to  problem  LP(w)  if  and  only  if  we  W(y), 

where  y  =  Cx. 

For  a  convex  set  S  in  R^,  the  intersection  of  all  convex  cones  containing  S  is  also  a 
cone  and  is  called  the  convex  cone  generated  by  S.  We  denote  the  convex  cone  generated 
by  a  convex  set  S  by  cone  (S). 

For  any  convex  set  U  in  R\  the  interior  and  the  relative  interior  of  U  will  be 
denoted  int  U  and  ri  U ,  respectively. 

Proposition  4.2.1.  For  a  point  y  in  Y,  let  Y-{y}  =  {y'-y|  y'e  Y}.  Then,  cone  (Y- 
(y})  is  a  polyhedral  cone  containing  the  orign  and  ' 

cone  (Y-{y})  =  {k(y'-y)l  y'e  Y,  k  >  0}. 
Proof  Since  Y  is  a  polyhedron  and  yeY,  Y-{y}  is  a  polyhedron  containing  the 
origin.  It  follows  from  Corollary  19.7.1  of  Rockafellar  (1970)  that  cone  (Y-{y})  is  a 
polyhedral  cone  containing  the  origin.  Furthermore,  by  Corollary  2.6.3  of  Rockafellar 
(1970)  we  have  cone  (Y-{y})  =  {k(y'-y)|  y'e  Y,  k  >  0}.  □ 

For  a  cone  K  in  R^,  the  cone  {z'e  R""!  <z',  z>  <  0  for  any  z  in  K}  is  called  the  polar 
cone  of  K  and  is  denoted  by  K  . 
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Proposition  4.2.2.  For  each  y  e  Y,  the  cones  cone  (Y-{y})  and  W(y)  are 
polyhedral  sets  and  are  polar  to  one  another. 

Proof.  The  resuhs  are  immediate  from  Theorem  2.1  of  Varaiya  (1967),  Theorem 
14. 1  of  Rockafellar  (1970),  and  Corollary  19.2.2  of  Rockafellar  (1970).  D 

Given  a  nonempty  convex  set  K  in  R*",  let  O^K  be  defined  by 
0^={yeR''|y  +  KcK}. 
The  set  O^K  is  called  the  recession  cone  of  K.  From  Theorem  8.1  of  Rockafellar  (1970), 
the  recession  cone  O^K  is  a  closed  cone  containing  the  origin.  If  K  is  a  closed  convex  cone, 
it  is  easy  to  verify  that  O^K  =  K.  Recall  that  the  lineality  of  a  nonempty  convex  set  K  is  the 
dimension  of  the  set  (-0^)  n  0^. 

Proposition  4.2.3.  Let  y  e  Yex-  Then,  the  lineality  of  cone  (Y-{y})  equals  zero. 

Proof  Since  y  e  Yex,  it  is  easy  to  show  that  cone  (Y-{y})  is  a  pointed  cone.  That 
is, 

(- cone  (Y-{y}))  n  cone  (Y-(y})  =  {0}. 

Therefore,  the  lineality  of  cone  (Y-{y})  equals  zero.  D 

Since  Y  is  a  polyhedron,  it  has  a  finite  number  of  extreme  points.  Therefore,  Y  has 
at  most  a  finite  number  of  efficient  extreme  points.  Since  Y  is  compact,  the  problem  of 
minimizing  w^y  over  Y  has  at  least  one  extreme  solution  for  any  w>0.  Therefore,  Y  has  at 
least  one  efficient  extreme  point.  Without  loss  of  generality,  assume  that  Ye  r\  Yex  = 
{y\. .  .,y''},  where  q  >  1  is  an  integer. 

Notice  that  the  efficient  outcome  set  of  problem  MOLP  is  identical  to  the  efficient 
decision  set  of  the  problem 
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v-max  y,     s.t.  yeY, 
where  Y  is  the  outcome  set  of  problem  MOLP.  By  applying  (4.3)  to  the  above  problem, 
we  obtain  the  following  result. 

Theorem4.2.1.Wc  UW(y'). 

i=l 

Theorem  4.2. 1  implies  that  W*^  can  be  decomposed  into  the  union  of  its  subsets  W^ 
r\  W(y'),  i=l,...,q.  We  will  call  this  decomposition  of  W"  the  outcome  set-based 
decomposition.  In  the  following,  we  will  present  some  properties  of  W(y')  Then  we  will 
show  that  the  decomposition  of  W°  given  above  establishes  a  one-to-one  correspondence 
between  the  efficient  extreme  points  y',  i  =  1,  2,. . .,  q,  of  Y  and  the  subsets  W°  o  W(y'),  i 
=l,...,q,ofW°. 

Theorem  4.2.2.  For  each  i  =  1,2,. . .,q,  W^n  int  W(y')  ^  0. 

Proof  Choose  i  g  (1,  2,  ...,  q}.  By  Propositions  4.2.1  and  4.2.2,  cone  (Y-{y'})  is 
a  polyhedron  in  R''  containing  the  origin,  and  cone  (Y-{y'})  and  W(y')  are  polar  to  each 
other.  Thus,  from  Corollary  14.6.1  of  Rockafellar  (1970),  the  dimension  of  W(y')  equals 
p-k,  where  k  is  the  lineality  of  cone  (Y-{y'}).  Since  y'  e  Yex,  by  Proposition  4.2.3,  the 
lineality  of  cone  (Y-{y'})  equals  zero.  Therefore,  the  dimension  of  W(y')  equals  p.  This 
implies  that  the  relative  interior  of  W(y')  equals  its  interior,  i.e. 

ri(W(y'))  =  int(W(y')).  (4.5) 

Since  y'  g  Ye,  W^nW(y')  ^  0.  Notice  that  W°  is  an  open  set.  Consequently,  by  Corollary 
6.3.2  of  Rockafellar  (1970),  it  follows  that 

W"  n  ri  (W(y')  ^  0.  (4.6) 

From  (4.5)  and  (4.6),  we  have  W°  n  int  (W(y'))  ^0.  U 
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Remark  4.2.1.  For  each  i  =  1,  2,  ...,  q,  since  int  (W"nW(y))  =  W"o  int  W(y),  it 
follows  from  Theorem  4.2.2  that  W*^  n  W(y')  has  a  nonempty  interior.  Based  upon  this 
result,  the  outcome  space-based  decomposition  method  will  subdivide  the  weight  set  W" 
into  a  union  of  subsets  of  W°  with  nonempty  interiors.  We  will  use  Example  4.2. 1  later  to 
illustrate  this  property.  The  example  will  also  show  that  this  property  does  not  hold  for  the 
decision  space-based  decompositions. 

Theorem  4.2.3.  Let  w  e  W^o  int  W(y')  for  some  i  G{l,...,q}.  Then  y'  is  the 
unique  optimal  solution  to  the  linear  program  " 

max  {w^yl  ysY}. 

Proof  Let  e'',  k  =  1,  ...,  p,  denote  the  vector  in  R""  whose  k-th  component  equals 
one  and  whose  other  components  equal  zero.  Since  W(y')  is  a  polyhedron,  it  is  a  convex 
set.  Since  we  int  W(y'),  this  implies  that  there  exists  a  scalar  M  sufficiently  large  so  that 
for  each  k=  l,...,p, 


Wk  „k 


w+— ^e'eintW(y'), 
M 

where  Wk  is  the  k-th  component  of  w.  Notice  that 

y(w  +  ^'')  =  pw  +  (— )w  =  (p  +  — )w.  (4.7) 

tt  M  M  M 

Setw''  =  w+ —e\k=  l,...,p,  and  sett  =  l/(p+ — ).  Then 
M  M 

t  >  0  and,  by  (4.7), 

w=2]tw'.  (4.8) 

k=l 

Since  weint  W(y'),  y'  is  an  optimal  solution  to  max  {w^y|  yeY}. 


"  -"r*  ..        -A  -.-^•-sy-- 
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Suppose  that  there  exists  a  vector  y  sY  such  that  w^y  =  wV-  By  (4.8),  we  have 


p 


y=Zt(w^)'y'   andw^y  =  Xt(w'')'y.        V  (4-9) 


k=l  k=l 

Since  w''Gint  W(y')  for  all  k  =  1,2,. , .,p,  we  have 

(wW  ^  (wYy 
for  each  y  in  Y  and  for  all  k=  1 , . . .  ,p .  Since  y  e  Y,  this  implies  that 

(w^)V^(w')'y  .  -  ^ 

for  each  k=l,. . .,p.  It  follows  from  t  >  0  that 

tCwVy*  >  t(wyy  (4.10) 

for  each  k=l,...,p. 

We  now  claim  that  for  each  k  =  1,  2,  ...,  p, 

(wVy  =  (wyy. 

Suppose,  to  the  contrary,  that  there  exists  some  kos  { 1,2, . . ,  ,p}  such  that 

(w'"')V>(w''»)^y. 
Then, 

t(w''°)V>t(w'"'fy.  (4.11) 

From  (4.9)-(4. 1 1),  we  see  that 


wV=  i;t(w^)'y'  >  Zt(w^)'y=w"y, 


k=l  k=l 

which  contradicts  the  assumption  that  w^y  =  w\'.  We  have  thus  proved  the  claim  that  for 
eachk-  1,  2,  ...,  p, 

(wWKwYy. 
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By  the  claim  proven  in  the  previous  paragraph  and  the  definitions  of  w\  k=l , .. .  ,p, 


M  M 


for  each  k  =  1 ,  . . . ,  p.  Since  w  y  =  w  y',  this  implies  that 

^(e^)V=^(e^fy  -  (4.12) 

MM 

for  each  k  =  l,...,p.  Since  w  e  W°,  we  know  that  Wk  >  0,  k  =  l,...,p.  Thus,  by  (4.12), 

since  M  >  0,  (e'')V  =  (e'')^y  for  each  k  =  1,. . . ,p.  As  a  result, 

y'=y. 

Consequently,  we  have  proven  that,  if  wV  =  w^y  and  y  eY,  then  y'  =  y .  Therefore,  y'  is 

the  unique  optimal  solution  to  max  {w\|  yeY}.  D 

Remark  4.2.2  Let  y'  be  an  efficient  extreme  point  of  problem  MOLP  in  the 
outcome  space.  From  Theorem  3. 1  in  Benson  (1982),  there  exists  a  weight  vector  w  in  W° 
such  that  y'  is  the  unique  optimal  solution  to  the  linear  program  max  {w^y|  yeY). 
Furthermore,  from  Theorems  4.2.2  and  4.2.3,  we  see  that  y'  is  the  unique  optimal  solution 
to  the  linear  program  max  (w'^yl  yeY}  for  any  we  W^o  int  W(y'),  where  W°r^  int 
W(yV0  This  observation  slightly  extends  the  result  in  Theorem  3.1  of  Benson  (1982). 
Theorem  4.2.4.  Suppose  that  i,  j  g  (1,  2,  ...,  q}  and  that  y'  ^  y*.  Then, 
W"  n  int  W(y')  o  W(y')  =  0.         ,'    -       ,  ' 

Proof  Suppose  that  W°  n  int  W(y')  r\  W(y')  ^  0.  Then,  we  may  choose  a  point  w 
in  W*^  r^  int  W(y')  n  W(y).  Since  w  e  W°  n  int  W(y'),  it  follows  from  Theorem  4.2.3  that 
y"  is  the  unique  optimal  solution  to  the  linear  program  '       .'^ 

max  (w^yl  yeY}. 


iir" 
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Since  w  g  W(y'),  y"  is  an  optimal  solution  to  the  linear  program 

max  {w\|  yeY}. 
Therefore,  y'  =  y*.  This  contradicts  y'  ^  y'.  Thus,  W°  r^  int  W(y)  o  WCy*)  =  0.  D 

Remark  4.2.3.  Theorem  4.2.4  implies  that  there  exists  an  outcome  space-based 
decomposition  of  W'*  that  consists  of  a  union  of  subsets  of  W°  with  no  interior  points  in 
common.  Later,  Example  4.2.1  will  illustrate  this  property. 

Theorem  4.2.5.  Suppose  that  i,j  e{l,  2,...,q}  and  that  y' ;^  y*.  Then,  W°  r^W(y')  ^ 

w^'owcy). 

Proof  The  result  follows  immediately  from  Theorem  4.2.2  and  Theorem  4.2.4.    D 
Remark    4.2.4.     Theorem    4.2.5     implies    that    there    exists    a    one-to-one 

correspondence  between  the  efficient  extreme  points  in  the  outcome  space  and  the  subsets 

of  the  corresponding  weight  set  W". 

Theorem  4.2.6  Let  H  be  a  nonempty  face  of  Y,  and  let  y,  y  be  two  points  in  ri  H. 
Then,  W(y)  =  W(y). 

Proof  Since  H  is  a  nonempty  face  of  Y,  it  is  a  convex  set.  In  fact,  from 
Rockafellar  (1970),  since  Y  is  a  polyhedron,  H  is  a  nonempty  polyhedral  set.  By  Theorem 
6.4  of  Rockafellar  (1970),  since  y,  y  g  ri  H,  we  may  choose  ti,  ti  >  1 .0  such  that 
(l-t,)y +tiyGH,  '""'■'-_. 

(l-t2)  y  +t2yeH. 
By  the  definition  of  W(  y ),  for  each  w  in  R'', 

weW(y)    iff    w'(z  -  y)  <  0,  for  all  z  g  Y,  • 


'  '\-\%'-    '     :■  •     '  .';  ■'.'  .  ■  > 
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iff    w'^Cz-  y)  +  w^(y-y)<0,forallze  Y,      (4.13) 

By  choosing  z  =  (1-ti)  y  +  tiy  in  (4.13),  we  obtain 

w^[t,(y-y)]  +  w^(y-y)<0. 

This  implies  that 

(t,-l)w^(y  -  y)<0. 

Since  ti  >  1,  we  see  that  '  .  ,     ,     ^ 

w^(y  -  y)<0.  '  '  ■  (4.14) 

Similarly,  by  choosing  z  =  (l-t2)  y  +  t2  y  in  (4. 13),  we  see  that 

w''(y-y)<0.  ■  '  (4.15) 

Together  (4. 14)  and  (4. 15)  yield 

w''(y-y)  =  0, 

so  that  w^y=  w^y.  By  definition  of  W(y),  this  implies  that  wGW(y)  if  and  only  if 

weW(y).  -\,  □ 

A  set  S'  is  said  to  be  a  proper  subset  of  S  if  S'  is  a  nonempty  subset  of  S  and  S  VS. 

Theorem  4.2.7  Let  I  be  a  proper  subset  of  {1,  2,.. .,  q}.  Then,  W"o  (UW(y'))  is 

a  proper  subset  of  W".  -'  '   -. 

Proof  Since  I  is  a  proper  subset  of  (1,  2,...,  q},  we  may  choose  somejejl,  2,..., 
q}  such  that  jgl.  By  Theorem  4.2.2,  we  can  choose  a  point  we  W°  n  int  W(y').  Since  j  ^ 
I,  we  have  ^^^y'  for  each  i  e  1.  It  follows  fi'om  Theorem  4.2.4  that  w  g  W(y')  for  each  i  g 
I.  Therefore,  wg  WV  (UW(y')).  Consequently,  W"n  ((J W(y'))  is  a  proper  subset  of 


fa 
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Remark  4.2.5.  Theorem  4.2.7  will  be  used  later  to  prove  that  the  Basic  Weight  Set 
Decomposition  Algorithm  for  finding  all  efficient  extreme  points  in  the  outcome  space  is 
finite  and  valid. 

The  following  example  is  a  slight  modification  of  Example  22  on  p.  185  of  Steuer 
(1986).  It  shows  that  the  outcome  space-based  decomposition  establishes  a  one-to-one 
correspondence  between  the  efficient  extreme  points  y',  i  =  1,  2,...,  q,  and  the  subsets  W** 
nW(y'),  i  =  1,  2,  ,..,  q,  of  W°.  It  also  shows  that,  for  each  i  e  {1,  2,  ...,  q},  W°  oW(y')  has 
a  nonempty  interior,  and  that,  for  any  i  ?t  j  and  i,  j  g  {1,  2,  ...,  q},  W^  r^W(y')  and  W° 
nWCy*)  have  no  interior  points  in  common. 

Example  4.2. 1 .  Consider  the  MOLP  problem 

max     xi  +  2x2        =  yi 

-2xi  =y2 

s.t.     2xi  +  X3  <  6 

-xi  +  3x2         ^6 

-Xi  +    X2  <  2 

X3  <  2 
Xi,  X2,  X3  >  0. 

The  decision  set  X  (see  Figure  4.1)  has  eight  extreme  points.  These  are  x'  =  (0,  2, 
0)\  x'  =  (0,  2,  2f,  x'  =  (3,  3,  0)\  x"  =  (2,  8/3,  2)\  x'  =  (0,  0,  0)\  x'  =  (0,  0,  2)\  x'  =  (2, 
0,  2)^  and  x^  =  (3,  0,  0)^.  Here,  x'  and  x^  are  each  degenerate  extreme  points,  and  x^  x", 
. . .  ,x^  are  nondegenerate  extreme  points.  It  can  be  shown  that  in  this  problem  Xcx  o  Xe  = 
(x',  x^,  x\  x'*}.  The  outcome  set  Y  (see  Figure  4.2)  has  four  extreme  points.  These  are  y' 
=  (4,  0)\  y^  =  (9,  -6)'^,  y^  =  (3,  -6)'^  and  y^  =  (0,  0)'^.  In  the  outcome  space,  the  set  of 
efficient  extreme  points  is  given  by  Yex  n  Ye  =  {y',  y^}.  In  Figure  4.2,  for  each  i  =  1,  2,  .... 
8,  y'  is  the  outcome  point  corresponding  to  x'. 
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Figure  4.1.  Decision  Set  X 


y'  =  /  =  0      y'  =  y'  =  (4,0) 


yi 


y  =(3,-6)' 


Figure  4.2.  Outcome  Set  Y 


y'=(22/3,-4f 


/  =  (9,  -6)^ 


It  can  be  shown  that 

W(x')  =  W(x^)  =  {wsR^I  wi  >  0,  5wi  -  6w2  <  0}, 
W(x^)  =  {wgR^I  wi  >  0,  5wi  -  6w2  >  0}, 


and 


WCx")  =  (wgR^I  wi  >  0,  5wi  -  6w2  =  0}. 
It  is  obvious  the  correspondence  between  x'  and  W^  r^  W(x'),  i  =  1,  2,  ...,  8,  is  not 
a  one-to-one  correspondence.  Notice  that  int  W(x'')  o  W"  =  0  and  that  int  (W^  o  W(x')) 
=  int  (W"  n  W(x^)). 


■*>■/».  4    *-v      t     ■vs. -3     V  ^?"»  V  ■'■  «  r'  ■■-    «A    -^  f/> 
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For  y'  and  y^,  it  is  not  difficult  to  show  that 

W(y')  =  {  weR^I  wi  >  0,  -5wi  +  6w2  >  0}, 

and 

W(y^)  =  {  wgR^I  wi  >  0, -5wi  +  6w2  <  0}. 
It  is  obvious  that  the  correspondence  between  y'  and  W"  o  W(y'),  i  =  1,  3,  is  a 
one-to-one  correspondence.  Notice  also  from  the  above  observations  that  while  int  W(x  ) 
n  W"  =  0,  int  W(y')  n  W*'  ;t  0  and  int  W(y^)  n  W"  ^  0,  Furthermore,  notice  that  W  = 
(W  nW(y'))  u  (W^  oW(y^)),  and  that  the  subsets  (W**  n  int  W(y^))  and  (W"  n  int  W(y^)) 
of  W"  have  no  points  in  common. 

4.3.  The  Basic  Weight  Set  Decomposition  Algorithm 

The  algorithm  BWSDA  is  based  on  the  decomposition  of  the  weight  set  W".  At 
each  iteration,  the  algorithm  will  first  either  find  a  weight  vector  which  will  lead  to  an 
unexplored  efficient  extreme  point  in  the  outcome  space  or  conclude  that  all  points  in  Yex 
n  Ye  have  been  found. 

Two  questions  arise.  One  is  how  to  find  a  weight  vector  which  will  lead  us  to  an 
unexplored  point  in  Yex  r\  Ye,  or  to  determine  that  such  a  weight  vector  does  not  exist. 
We  will  address  this  question  later.  The  other  question  is  how  to  find  a  point  in  Yex  r\  Ye, 
given  a  weight  vector  in  W°.  The  following  two  results  will  answer  the  latter  question. 

Theorem  4.3.1.  Assume  that  w  is  a  weight  vector  in  W°.  If  x*  is  the  unique  optimal 
solution  to  problem  LP(w),  then  y*  =  Cx*  is  an  efficient  extreme  point  of  problem  MOLP 
in  the  outcome  space  R''. 
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Proof.  Since  x*  is  the  unique  optimal  solution  to  problem  LP(w),  y*  is  the  unique 
optimal  solution  to  the  problem  max  {w'^y|  yeY}.  By  linear  programming  theory,  this 
implies  that  y*  is  an  extreme  point  of  Y.  Since  wgW^,  it  follows  from  Geoffrion  (1968) 
that  X*  is  an  efficient  solution  of  problem  MOLP.  Therefore,  y*  is  an  efficient  outcome  of 
problem  MOLP.  Consequently,  y*  is  an  efficient  extreme  point  of  problem  MOLP  in  the 
outcome  space  R"".  D 

Theorem  4.3.2.  Assume  that  w  is  a  weight  vector  in  W"  and  that  x*  is  an  optimal 
solution  to  problem  LP(w).  If  y'  is  an  extreme  point  of  the  set  Y  o  {y  g  R*"!  w^  = 
w^Cx*),  then  y'  is  also  an  efficient  extreme  point  of  problem  MOLP  in  the  outcome  space 
RP. 

Proof  Notice  that  as  in  the  proof  of  Theorem  4.3.1,  it  follows  that  x*  is  an 
efficient  solution  of  problem  MOLP  and  y'  is  an  efficient  outcome  of  problem  MOLP. 
Thus,  we  only  need  to  prove  that  y'  is  an  extreme  point  of  Y. 

Suppose,  to  the  contrary,  that  y'  is  not  an  extreme  point  of  Y.  Then,  there  exist  y\ 
y^GY,yVy^  such  that 

y'  =  ty'  +  (l-t)y' 
for  some  t  such  that  0  <  t  <  1 .  Choose  such  a  t.  Then 

wV  =  tw'^y '  +  ( 1  -t)w^y'.  (4.16) 

We  claim  that  w^'  =  w^.  To  show  this  claim,  suppose  that  w\'  ^  w^. 
Without  loss  of  generality,  suppose  that  w\'  <  w^-  It  then  follows  from  (4. 16)  that 

wV<twV  +  (l-t)wV 

=  wy.  (4.17) 


-:■:■         >  ■         83 

Since  y'  is  in  Y  n  {y  g  R^I  w^y  =  w^Cx*},  wV  =  w^Cx*.  Because  y^eY,  we  may  choose 
a  vector  x^eX  such  that  y^  =  Cx^  As  a  result,  by  (4. 17),  it  follows  that 

w'^Cx*  <  w'^Cx^ 
But  since  x^gX,  this  contradicts  that  x*  is  an  optimal  solution  to  problem  LP(w),  so  that 
the  claim  must  hold. 

By  (4.16)  and  the  claim  proven  in  the  paragraph  above, 
w'^Cx*  =  w'^y'  =  w^y'  =  wV . 
Therefore,  y",  y^e  Y  n  (y  e  R""!  w^y  =  w^Cx*}.  This  contradicts  that  y'  is  an  extreme 
point  of  Y  n  (y  G  R""]  w^y  =  w^Cx*}.  Hence,  our  assumption  that  y'  is  not  an  extreme 
point  of  Y  must  be  false.  D 

Basic  Weight  Set  Decomposition  Algorithm  (BWSDA) 
STEP  1.     Set  W'  =  W".  Choose  any  point  w^  g  WV  Find  any  optimal  extreme  point 

solution  x' to  problem  LP(w').  Set  k  -  1,  EX°  ;=  0,  EY°  ;=  0. 
STEP  2.     If  x ''  is  the  unique  optimal  solution  to  problem  LP(w''),  then  set  x*"  =  x  "^  and  y*" 

=  CxV  Otherwise,  find  any  extreme  point  /  of  the  set  YnlyGR^l  (w^)^y  = 

(w^)'^C  X " } ,  and  any  extreme  point  x''  of  X  such  that  y"'  =  Cx\  Set  EX''  =  EX''"' 

u{x'),  EY"  =  EY'-' o{/}  and  W"^' =  W^W(y''). 
STEP  3.     Find  any  point  w''^'  in  W*"^'.  If  such  a  point  w''^^  does  not  exist,  stop:  Yex  n  Ye 

=  EY^  Otherwise,  go  to  STEP  4. 
STEP  4.     Find  any  optimal  extreme  point  solution  x''*'  to  problem  LPCw""*^).  Set  k  := 

k+1  and  go  to  STEP  2. 
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Notice  that  the  feasible  region  of  problem  LP(w)  is  a  nonempty  compact 
polyhedral  set.  Thus,  for  any  point  w  in  R^,  problem  LP(w)  has  at  least  one  optimal 
extreme  point  solution.  Thus,  STEP  1  and  STEP  4  are  well  defined. 

In  STEP  2,  if  x ''  is  the  unique  optimal  solution  to  problem  LP(w''),  then  it  follows 
fi-om  Theorem  4.3. 1  that  y''  =  Cx''  is  an  efficient  extreme  point  of  problem  MOLP  in  the 
outcome  space  R**.  Otherwise,  the  algorithm  calls  for  finding  an  extreme  point  of  the 
compact  polyhedral  set  YnlyeRPI  (w^y  =  (wYCx'}.  By  the  theory  of  linear 
programming,  such  an  extreme  point  y''  always  exists.  Therefore,  STEP  2  is  well  defined. 
Furthermore,  by  Theorem  4.3.2,  y''  is  an  efficient  extreme  point  of  problem  MOLP  in  the 
outcome  space  R*". 

In  STEP  3,  if  W''"'  =  0,  then  the  algorithm  stops.  Otherwise,  the  algorithm  calls 
for  finding  any  point  in  W''^'.  Therefore,  STEP  3  is  also  well  defined. 
.  ..         The  following  result  shows  that  the  algorithm  is  finite  and  valid. 

Theorem  4.3.3.  The  Basic  Weight  Set  Decomposition  Algorithm  terminates  at 
iteration  q  >  1,  and  EV  =  Yex^i  Ye,  where  q  is  the  number  of  points  in  Yex^i  Ye. 

Proof  Since  Y  is  nonempty  and  compact,  problem  MOLP  has  at  least  one  efficient 
extreme  point  in  the  outcome  space.  Thus,  q  >  1.  Since  X  and  Y  are  nonempty  and 
compact,  we  can  always  find  the  point  y'  called  for  in  STEP  2  of  the  first  iteration  of 
algorithm  BWSDA. 

Suppose  that  k  >  1  and  EY*'  =  {y',  ...,  y''}.  It  follows  from  Theorems  4.3.1  and 
4.3.2  that,  for  each  1  <  i  <  k,  y'  is  an  efficient  extreme  point  of  problem  MOLP  in  the 
outcome  space.  Thus,  EY''  is  a  set  of  efficient  extreme  points  of  problem  MOLP  in  the 
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outcome  space.  Suppose  that  EY''  ^  Yex  n  Ye.  In  Theorem  4.2.7,  let  I  =  {1,  2,...,k}. 

'1.-' 

k 

Then,  we  have  that  W^ndJWCy'))  is  a  proper  subset  of  W*'.  From  this,  there  is  a  point  w 


in  W°  such  that  w  €  U^(y') '  '^  '  ^"^^  ^^^^  ^  ^^''"'  Therefore,  when  EY"  *  Yex  n  Ye 


1=1 


the  algorithm  can  always  find  a  point  W'^'  g  W''^'  in  STEP  3  of  iteration  k,  and  the 
algorithm  will  continue  at  least  to  STEP  2  of  iteration  k+1.  In  STEP  2  of  iteration  k+1, 
the  algorithm  will  then  find  a  new  point  y^"^'  e  YexO  Ye  such  that  w''"'g  W(y''^').  Since 

k 

w''^'  0  U^(y') '  ^^'^  ^W(y')  for  any  1  <  i  <  k.  Therefore,  /"'  ^  y'  for  all  1  <  i  <  k.  This 

i=l 

implies  that  when  EY*'  i^  Yex  r^  Ye,  the  algorithm  will  continue  to  the  next  iteration  where 
it  will  find  an  unexplored  point  in  Yex  r\  Ye.  Since  the  number  of  points  in  Yex  r\  Ye  is  q, 
the  algorithm  will  eventually  stop  in  iteration  q  with  EY^  =  Yex  r^  Ye.  □ 

Now,  we  address  the  implementation  of  BWSDA. 

In  STEP  1  or  STEP  4,  we  need  to  find  any  optimal  extreme  point  solution, 
denoted  by  x  "^ ,  to  the  linear  programming  problem  LPCw*")  for  some  k  >  1 .  This  can  be 
accomplished,  for  instance,  by  using  the  simplex  method  of  linear  programming. 

In  STEP  2  of  BWSDA,  for  any  given  k,  it  may  be  necessary  to  find  an  extreme 
point  y''  of  the  set  Yr^{yeR''|  (w^Y  =  (w'')'Cx'' },  and  any  extreme  point  x''  of  X  such 
that  ^  =  Cx''.  We  explain  now  one  method  for  accomplishing  this. 

By  definition  of  Y,  YnfyeRP]  (w^y  =  (w^f  Cx"  }=  {Cx|  Ax  <  b,  x  >  0,  (w^f  Cx 

=  (w^fCx''}.Let 

D  =  [C,  Op.„], 
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.    t. 

A 

mxm 

.(w^)^C 

0,xm. 

k\T/-.— k 


and 


(w')'Cx 


Z={z|  Az=  b,z>0}, 


where  z'  =  (x',  s')  e  R"^.  Then 


YnlyeR"!  (w'')'y  =  (w'')'Cr  }  =  DZ  =  {Dz|  z  gZ}. 
Since  x''  is  an  extreme  point  of  {x  e  R"|  Ax  <  b,  x  >  0),  it  is  also  an  extreme  point  of  (x 
e  R"  I  Ax  <  b,  X  >  0,  (w^Cx  =  (w^f  Cx'' }.  It  follows  that  ((x'')'^,(s'')^)  is  an  extreme 
point  of  Z,  where  s''  =  b  -  Ax"" .  We  need  to  find  an  extreme  point  y""  of  DZ  and  an 
extreme  point  x''  of  X  such  that  y""  =  Cx^  Starting  with  z  =  ((x'')^,(s'')^ ),  we  can  find 
such  points  y""  and  x""  by  using  an  algorithm  in  Benson  and  Sun  (2000).  Using  this 
approach,  we  obtain  the  following  procedure. 
Procedure  for  finding  y''  and  x"  in  STEP  2  of  BWSDA-  Subprocedure  I: 


Stepl.  Find  any  optimal  extreme  point  solution,  denoted  by  z 


,  to  the  following 


linear  program  LPDi: 

LPD,:       min<Di,  z>    st  z  e  Z, 
where  Di  denotes  the  first  row  of  D.  If  z'  is  the  unique  optimal  solution  to  LPDi,  then  set 
x''  =  x' ,  y''  =  Cx'  and  stop.  Otherwise,  let  vi  denote  the  optimal  value  of  LPDi,  set  i=2, 
and  go  to  Step  i. 


#"T»sr'.j''<^f„ 
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^x'^ 


Step  i  (i  =  2,  3,...,p).  Find  any  optimal  extreme  point  solution,  denoted  by  z'  =     '    ,  to 

the  following  linear  program  LPDi: 

LPDi!       min  <Di,  z>, 

s.t,  <Dt,  z>  =  vt,  t=l,2,  .,.,i-l, 
z  e  Z, 

where  Dt  denotes  the  t-th  row  of  D,  and  v,  is  the  optimal  value  for  LPD,.  If  z'  is  the  unique 

optimal  solution  to  LPDi,  or  if  i  =  p,  then  set  x''  =  x',  y''  =  Cx'and  stop.  Otherwise,  let  Vi 

denote  the  optimal  value  of  LPD;,  set  i  =  i+1,  and  go  to  Step  i. 

From  Benson  and  Sun  (2000),  the  point  y''  obtained  by  the  above  procedure  is  an 
extreme  point  of  DZ  =  YnlyeRPI  (w^y  =  (w^fCx''}.  Notice  that  Subprocedure  I 
involves  solving  at  most  p  linear  programming  problems.  The  following  result  shows  that 
the  point  x''  obtained  by  the  procedure  is  an  extreme  point  of  X. 

Theorem  4.3.4.  The  point  x''  obtained  by  Subprocedure  I  is  an  extreme  point  of  X. 

Proof  It  is  obvious  whenever  the  procedure  stops  at  some  Step  i,  i  >  1,  that  x 
eX.  Suppose,  to  the  contrary,  that  x''  is  not  an  extreme  point  of  X.  Then,  there  exist  x',  x" 
in  X  such  that  x'  -^  x"  and 

x''  =  ax'  +  (l-a)x"  (4.18) 


for  some  a  such  that  0  <  a  <  1   Since  z' 


r^A 


vS  y 


G  Z  and  X  =  x' ,  it  follows  that 


iv/fCx^  =  iv/fCx\ 


This  implies  that  x''  is  an  optimal  solution  to  problem  LP(w''),  since  x''  is  an  optimal 
solution  to  this  problem.  This  together  with  (4.18)  yields  that  x'  and  x"  are  also  optimal 
solutions  to  problem  LP(w'').  Therefore, 
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(w')^C  x'  =  (w^)^C  X " ,  (w')''C  x"  =  (w'')^C  X " . 
Notice  that  x'  and  x"  are  in  X.  Thus,  x'  and  x"  are  distinct  points  in  {x  e  R"|  Ax  <  b,  x  >  0, 


(w'')'Cx  =  (w')'Cx'' }.  Let  s'  =  b  -  Ax',  s"  =  b  -  Ax",  z'  = 


^x'^ 


vSy 


and  z" 


'  X   ^ 


vs  J 


We  then 


have  that  z'  and  z"  are  two  distinct  points  in  Z  such  that 

z'  =  az'  +  (l-a)z".'  (4.19) 

Therefore, 

Dz'  =  aDz'  +  (l-a)Dz", 
From  this  equation,  since  z'  is  an  optimal  solution  to  problem  LPDi,  we  obtain  that  for 
eacht  =  1,  2,....,i, 

V,  =  <D,,  z'>  =  a<Dt,  z'>  +  (1-  a)<D,,  z">.  (4.20) 

With  t  =1,  since  z',  z"  g  Z  and  0  <  a  <  1,  (4.20)  implies  that  z'  and  z"  are  distinct 

optimal  solutions  to  problem  LPDi.  As  a  resuh,  z'  and  z"  are  feasible  solutions  to  problem 

LPD2.  By  setting  t  =  2  in  (4.20),  since  0  <  a  <  1,  this  implies  together  with  (4.20)  that  z' 

and  z"  are  distinct  optimal  solutions  to  problem  LPD2.  As  a  result,  z'  and  z"  are  feasible 

'.V*  "  ■■  ■  "    "'   • 

,.--  .        solutions  to  problem  LPD3.  With  t  =  3  in  (4.20),  this  implies  in  a  similar  manner  that  z' 
and  z"  are  distinct  optimal  solutions  to  problem  LPD3.  By  continuing  in  this  fashion,  we 
-*:*  see  that  z'  and  z"  are  distinct  feasible  solutions  to  problem  LPDj.  This  together  with  (4. 19) 

yields  that  z'  is  not  an  extreme  point  of  the  feasible  region  of  problem  LPDi.  This 
contradicts  that  z' is  an  optimal  extreme  solution  of  problem  LPDi.       ,,.;.,  D 

In  STEP  3,  we  need  to  find,  if  it  exists,  a  point  w^^'  e  W""^',  where  W'''"'  is  usually 
a  non-closed,  nonconvex  cone.  We  will  present  two  approaches  that  either  find  a  point 
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w*"^'  e  W''"'  or  show  that  no  such  point  exists.  These  two  approaches  will  yield  two 
versions  of  the  Basic  Weight  Set  Decomposition  Algorithm,  WSDA-I  and  WSDA-II. 

'■    .'  :■      "'  '  t 

.'  -^ .  * 

4.3.1.  Tree  Search  Approach  for  STEP  3  of  BWSDA 

k 

Let  k  e  {1,  2,  ...,  q}.  Notice  that  W''"  =  W"  \  UW(y').  To  introduce  the  first 

1=1 

approach,  we  will  first  present  some  necessary  and  sufficient  conditions  for  w  g  W(y'), 
where  i  g  {1,  2,...,q}. 

Suppose  that  x  e  X,  y  e  Y,  and  y  =  Cx.  Notice  that  W(y)  =  {  wgRP]  w'^y  >  w'^y' 
for  all  y'  in  Y  }  =  {  wgR^I  w^Cx  >  w^Cx'  for  all  x'  in  X  }.  Therefore,  w  e  W(y)  if  and 
only  if  x  is  an  optimal  solution  to  problem  LP(w).  By  duality  theory  of  linear 
programming,  this  implies  that  w  e  W(y)  if  and  only  if  there  exists  a  point  u  e  R"  such 

that 

CV-A^u<0,  (4.21) 

u^(Ax  -  b)  =  0,  (4.22) 

x^(CV  -  A^u)  -  0,  (4,23) 

u>0.  (4.24) 

Let  Ai  be  the  ith  row  of  A  for  i  =  1 ,  2, . . .  ,m,  and  let  E;  be  the  ith  row  of  the  nxn 

identity  matrix  for  i  =  1,  2,  ,..,n.  For  each  given  pair  (x',  y'),  i  =  1,  2,...,q,  where  x'  is  an 

extreme  point  of  X  and  y' =  Cx',  let 

ID(x')={je{l,2,...,m}|Ajx'  =  bj}. 

For  each  i  =  1,  2,  ...,  q,  let  A'  be  the  matrix  whose  rows  are  Aj,  jgID(x').  For  each  i  =  1,  2, 

...,  q,  if  ID(x')  =  0,  let  A*  equal  the  scalar  0.  For  each  i  =  1,  2,  ...,  q,  let 
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lV)={Je{l,2,...,n}|x;  =  0}, 
and  let  E'  be  the  matrix  whose  rows  are  Ei,  1gI°(x').  For  each  i  =  1,  2,  ...,  q,  if  ^(x')  =  0, 
let  E'  equal  the  scalar  0. 

Let  i  G  (1,  2,  ...,  k}.  From  (4.21)-(4.24),  we  know  that  w  e  W(y')  if  and  only  if 
there  exist  a  vector  u'  >  0  and  a  vector  v'  >  0  such  that 

C''w-(A')V  +  (E')V  =  0.  ■^^.  (4.25) 

Therefore,  w  g  W(y')  if  and  only  if  the  above  linear  system  (4.25)  of  n  equations  has  no 
solution  (u',  v')  >  0.  By  Farkas'  Lemma,  this  implies  that  w  g  W(y')  if  and  only  if  there 
exists  a  point  d'  6  R"  such  that 

wW    >0,  ■  ;.-^'-       ■' 

A*d' <  0,  E'd' >  0. 

Let  ^  ■    . 

D(i)  =  {d'GR"|A'd'<0,E'd'>0}, 
and  let  CD(i)  be  the  image  of  D(i)  under  C.  We  immediately  obtain  the  following  result. 

Theorem  4.3.5.  Let  i  g  { 1,  2,  ...,  q}.  For  a  given  w  g  R^,  w  g  W(y')  if  and  only  if 
there  exists  d'  e  D(i)  such  that  w^Cd'  >  0.  \> 

The  following  theorem  gives  a  way  to  generate  D(i)  and  CD(i)  for  each  i  =  1,  2,  ..., 
q.  For  any  set  T  e  R",  let  cone  T  =  {at  |  a  >  0,  t  g  T}. 

Theorem4.3.6.  Foreachi=  1,  2,...,q,  wehave 

(l)D(i)  =  cone(X-{x'}); 

(2)  CD(i)  =  cone  (Y-{y'}). 
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Proof.  (1).  (a)  First,  we  will  show  D(i)  c  cone  (X-{x'})  for  any  given  i  g  {1,  2,  ..., 

q}-  '  ■;■•  -V     ; 

Let  i  G  {1,  2,...,  q},  and  let  d  e  D(i).  Then,  A'd  <  0,  E'd  >  0.  Let  t  be  any  positive 
number.  It  follows  immediately  that  A'(td)  <  0,  E'(td)  >  0.  Therefore,  A'(td  +  x'  -  x')  <  0 
and  E'(td  +  x'  -  x')  >  0.  This  implies  that   "         •     ,  ■   -  • ,. 

A'(td  +  x')  <  AY  =  b\  •    "  (4.26) 

EXtd  +  x')  >  EV  =  0,  (4.27) 

where  b'  is  the  vector  whose  components  are  bj,  j  gID(x').  For  each  j  ^  ID(x'),  we  have 

Ajx'  <  bj. 
Thus,  for  t  sufficiently  small,  we  have 

Aj(td  +  x*)<bj  •      ■      (4.28) 

foralljglD(x').  By  (4.26)  and  (4.28),  •, 

A(td  +  x')<b,  .'     "         ^  ..^        (4.29) 

for  t  sufficiently  small.  Similarly,  notice  that,  for  any  j  g  ^(x'),  Xj'  >  0.  Thus,  when  t  is 
sufficiently  small,  we  have  <  ;. 

tdj  +  Xj'>0,  ■"        (4.30) 

for  all  j  g  I°(x').  By  (4.27)  and  (4.30),  we  have 

td  +  x'>0,  (4.31) 

for  t  sufficiently  small.  From  (4.29)  and  (4.31),  we  may  choose  a  t  >  0  such  that  td  +  x'  e 
X.  Then,  td  g  X  -  {x'}.  Since  cone(X-{x'})  is  a  cone  and  t  >  0,  this  implies  that  d  g 
cone(X-{x'}).  We  have  thus  proven  that  D(i)  e  cone  (X-{x'}). 


(b)  We  now  will  prove  the  opposite  inclusion.  Let  d  g  cone  (X-{x'}).  Then,  we 
may  choose  X  e  X  and  t  >  0  such  that 

d  =  t(x-x').  ;  ,-  ^      .        ,   t 

By  the  definitions  of  A'  and  b',  since  x  e  X,  this  implies  that  A'd  =  t(A'x  -  A'x')  =  t(A'x  - 
b')  <  0.  Furthermore,  since  x  e  X,  this  also  implies  by  definition  of  E'  that  E'd  =  t(E'x  - 
E'x')  =  tE'x  >  0.  Therefore,  d  g  D(i).  We  have  thus  proved  that  cone  (X-{x'})  c  D(i). 
■    •         By  (a)  and  (b),  D(i)  =  cone  (X-{x'}). 

(2).  Let  i  e  {1,  2,...,  q}.  It  is  obvious  that 

C(cone  (X-{x'}))  =  cone  (Y-{y'}). 
This  implies  fi-om  the  first  part  of  this  theorem  that 

CD(i)  -  cone  (Y-ly'}).  D 

Let  i  e  {1,  2,  ...,  q}.  Since  X  is  a  polyhedral  convex  set  and  x'  is  an  extreme  point 
of  X,  cone(X-{x'})  is  a  polyhedral  convex  cone  generated  by  the  edges  of  X  emanating 
from  x'.  It  follows  that  D(i)  is  a  polyhedral  convex  cone  generated  by  the  edges  of  X 
emanating  fi-om  x'.  Since  X  is  compact,  all  edges  of  X  emanating  fi-om  x'  can  be  exactly 
determined  by  determining  all  extreme  points  of  X  adjacent  to  x'. 

Let  Sat(x')  denote  the  set  of  all  extreme  points  adjacent  to  x'  in  X.  Then,  D(i)  can 
be  generated  by  determining  all  points  in  the  set  Sat(x')  -{x'}.  The  set  Sat(x')  can  be 
generated  by  using  the  simplex  method.  Similarly,  CD(i)  is  a  polyhedral  convex  cone 
generated  by  the  edges  of  Y  emanating  from  y'.  If  we  let  Sat(y')  denote  the  set  of  all 
extreme  points  adjacent  to  y'  in  Y,  then  CD(i)  can  be  generated  by  determining  all  points 
in  Sat(y')  -  (y'}.  The  set  Sat(y')  can  be  generated  by  using  the  algorithm  in  Benson  and  Sun 
(2000). 
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Theorem  4.3.7.  For  each  i  =  1,  2,. . .,  q,  w  g  W(y')  if  and  only  if  there  exists  a  point 

x^  G  Sat(x')  -{x'}  such  that  w'^Cx^  >  0. 

Proof  Without  loss  of  generality,  assume  that  for  some  positive  integer  li  that 
Sai(x')  =  {x''\  x''V...,x''''  }.  Since  D(i)  can  be  generated  by  all  points  in  Sa,(x')  -{x'},  we 
have 

D(i)={X«.(x''-x')|«,  >0,t=l,2,...,l,}. 

1=1 

By  Theorem  4.3.5,  w  g  W(y')  if  and  only  if  there  exists  a  point  d'  g  D(i)  such  that 

w'^Cd'  >  0. 

1, 
Suppose  that  d' =  ]^a,(x''  -x'),  where  a,  >  0,  t  =  1,  2,...,  Ij.  Then, 

t=i 

w^Cd'=2«.w''C(x''-x'). 

1=1 

If  w^Cd'  >  0,  then  from  the  above  equation,  there  exists  at  least  one  j  g  {1,  2,  ..., 
li}  such  that  w^CCx'-'-  x')  >  0.  Set  x^  -  x'^-  x'.  Then  w^^Cx^  >  0. 

On  the  other  hand,  if  x^  g  Sat(x')  -{x'}  and  w'^Cx^  >  0,  then  by  Theorem  4.3.5, 
since  x'  g  D(i),  w  g  W(y').  n 

k 

Remark  4.3.1.  Let  k  g  (1,  2,  ...,  q}.  From  Theorem  4.3.7,  w  g  (JW(y')if  and 

1=1 

only  if  there  are  points  x'  e  Sat(x')  -  {x'},  i  =  1,  2,...,k,  such  that  w^Cx'  >  0  for  all  i  =  1, 

k 

2,  ...,k.  Notice  that  W""'  =  W°  \  UW(y') .  So,  w  g  W''"'  if  and  only  if  w  >  0  and  there 

i=l 

are  points  x' g  Sat(x*)  -  (x'},  i=  l,2,...,k,  such  that  w'^Cx'  >  0  for  all  i  =  1,  2,  ...,k. 
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Remark  4.3.2.  Assume  k  e  (1,  2,  ...,  q}.  If  there  is  no  w  in  W"  and  no  x'  e  Sat(x') 
-  {x'},i=  1,2,...,/,  where  1  </<k  such  that 

w^Cx'>0,  (4.32) 

for  all  i=  1,  2,  ...,/,  then,  for  any  points  x' e  Sat(x')  -  {x'},  i  =  /+l,  1+2,...,  k,  there  is  no  w 
in  W"  such  that  (4,32)  holds  for  all  i  =  1,  2,. .  .,k.  ■  ■•    v^l 

Let  k  G  (1,  2,  ...,  q}.  By  Remark  4,3.1,  we  can  establish  a  tree  search  method  for 
finding  a  point  w  g  W*^"^'  or  deciding  that  W'^'^'  =  0.  The  main  idea  is  to  search  for  a  set  of 
points  x',  x\....,x''  in  Sat(x')  -{x'},  Sat(x^)  -{x^},...,  Sat(x'')  -{x''},  respectively,  such 
that  the  linear  system 

j"'C^'^''       -• "^  (4,33) 

[  w>e 

has  at  least  one  solution  w.  If,  for  a  set  of  given  points  x'  g  Sat(x')  -  {x'},  i=  1,  2,...,k,  the 
linear  system  (4.33)  has  a  solution  w,  then  this  w  is  in  W'^^V  If  (4.33)  has  no  solution  for 
any  combination  of  points  in  Sat(x')  -{x'},  i=  1,  2,. .  .,k,  then  W  *  =  0. 

Furthermore,  by  using  Remark  4.3.2,  we  can  add  a  little  intelligence  to  make  the 
search  shorter.  To  illustrate  the  tree  search  method,  we  will  use  the  tree  diagram  shown  in 
Figure  4.3. 

Suppose  that  k  e  {1,  2,  ...,  q}  and  that  Sat(x')  =  {x'-\  x''^...,  x''"'  },  i  =  1,  2,  ...,k. 
The  tree  has  a  root  node.  At  iteration  k,  the  tree  has  k  levels.  In  Figure  4.3,  we  only  show 
three  levels.  The  i-th  level  represents  the  i-th  iteration  of  the  BWSDA,  where  1  <  i  <  k.  At 
each  level,  there  is  a  list  of  nodes.  Each  node  determines  exactly  one  path  starting  from 
this  node  to  the  root  of  the  tree.  The  path  determined  by  a  node  in  the  i-th  level  is  called  a 
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path  from  the  i-th  level.  On  each  path  from  the  i-th  level,  there  are  i  nodes,  excluding  the 
root  node.  For  each  node  in  level  i,  a  point  in  Sat(x')  -  (x'}  is  assigned  to  it.  So,  each  path 
from  the  i-th  level  determines  a  set  of  i  points  in  Sat(x')  -  {x'},  ...,  Sat(x')  -  {x'}. 


respectively. 


\  -  i     A 


4/ 


"% 


■4  ':. 


Root  node) 


x^-'-x^    x^'^-x^ 


X  '•'  -  X 


Figure  4.  3.  Schematic  of  Tree 

Since  we  are  only  interested  in  the  set  of  points  determined  by  a  path,  we  will  use 
the  set  of  points  on  a  path  to  represent  this  path.  For  example,  (x'"'^  -  x\  x^'-  x^)  is  a  path 
from  the  second  level.  Each  node  has  a  parent  node  and  may  have  one  or  more  than  one 
offspring  node.  If  a  node  has  no  offspring  node,  we  say  the  path  determined  by  this  node 
died.  For  example,  the  path  (x'"^  -  x\  x'^''-  x^)  from  the  second  level  died  in  the  second 
level  (or  second  iteration). 

Let  Li  denote  the  set  of  those  live  paths  from  level  i.  For  example,  Li  =  {(x'^^-x'), 
...,  (x'-''  -  x')}  in  Figure  4.3.  The  set  of  all  paths  from  level  (i+1)  is  {(z\  z^)|  z'  g  Li,  z^  e 
(Sat(x'^')-{x'^'})}. 


.■.;.  Suppose  that  k  >  1.  At  the  k-th  level,  we  need  to  find  a  w''*'  e  W""^'  or  determine 
that  W'''^'  =  0.  Recall  that  the  set  of  all  paths  for  level  k  is  Lk  =  {(z\  z^)|  z'  e  Ln,  z^  e 
(Sat(x'')-{x''})}.    The   tree   search   chooses   a   path  /?   from   Lk.    Suppose   that  p   = 

(x',x',...,x''),  where  x^  g  SatCx^Xx*},  j  =  1,2,  ...,  k.  Next,  for  each  j  =  1,2,  ...,  k,  we 

set  x^  in  (4.33)  equal  to  x^  Then,  we  attempt  to  solve  the  linear  system  (4.33).  If  (4.33) 
has  a  solution  w*,  we  set  w''*^  =  w*.  If  (4.33)  has  no  solution,  we  set  Lk  =  Lk\{/7}.  This 
means  that  the  path/?  died  in  iteration  k  (or  level  k).  Next,  we  check  to  see  if  Lk  =  0.  If 
so,  we  have  that  W*^"'  =  0  Otherwise,  we  choose  a  new  path  from  Lk  and  repeat  the 
above  procedure. 

By  using  the  above  tree  search  approach  in  STEP  3  of  the  Basic  Weight  Set 
Decomposition  Algorithm  (BWSDA),  we  obtain  the  following  version  of  BWSDA,  which 
we  call  the  Weight  Set  Decomposition  Algorithm- 1  (WSDA- 1). 
Weight  Set  Decomposition  Algorithm-  I  (WSDA-  I)  •  ^ 

STEP  \.     Set  W'  =  W*^.  Choose  any  point  w'  e  WV  Find  any  optimal  extreme  point 

solution  x'  to  problem  LP(w').  Set  k  :=  1,  EX°  :=  0,  EY"  :=  0. 
STEP  2.     If  X ''  is  the  unique  optimal  solution  to  problem  LP(w''),  then  set  x''  =  x  ^  and  y'' 

=  Cx'' .  Otherwise,  find  x''  and  y''  by  using  the  procedure  explained  in  Section 

3. 

Let  Sat(x'')  be  the  set  of  all  extreme  points  in  X  that  are  adjacent  to  x''.  Find 

Sa,(x''),  and  let  D'(k)  =  Sa,(x'')  -{x"}. 

Set  EX'  =  EX"-'  ^{x^},  EY"  =  EY"^"'  ^{y^},  and  W'"'  =  W'\W(y''), 


97 

STEP  3.     3.1.    If  k  =  1,  let  U  =  D'(l).  Otherwise,  let  U  =  {(z',  z^)|  z'  e  Ln,  z^  g 
D'(k)}.  Suppose  that  M  is  the  number  of  elements  in  Lk.  Set  j  =  1. 

3.2.  Choose  p' e  Lk.  Suppose  that  p*  =  (x',  x\....,x''). 

3.3.  Determine  whether  or  not  (4  33)  has  a  solution.  If  (4  33)  has  a  solution 
w*,  set  w*""^^  =  w*  and  go  to  STEP  4.  If  (4.33)  has  no  solution  and  j  =  M, 
stop:  Yex  n  Ye  =  EY*'.  If  (4.33)  has  no  solution  and  j  <  M,  set  Lk  = 
LkHp"},  set  j  =  j  +  1,  and  go  to  STEP  3.2. 

STEP  4.     Find  any  optimal  extreme  point  solution  x''*'  to  problem  LP(w'''^^).  Set  k  := 
k+1  and  go  to  STEP  2. 

4.3.2.  Concave  Programming  Approach  for  STEP  3  of  BWSDA 

In  Section  4.3.1  we  presented  a  tree  search  approach  for  finding  a  point  w""*'  g 
W''^'  or  determining  that  W''"  =  0  in  STEP  3  of  the  Basic  Weight  Set  Decomposition 
Algorithm  (BWSDA).  Based  upon  this  approach,  we  presented  the  algorithm  WSDA-  I. 
Now,  we  will  develop  an  ahernative  approach  for  implementing  STEP  3  of  BWSDA.  This 
approach  solves  the  problem  of  finding  a  point  w''*'  g  W**"'  by  finding  a  global  optimal 
solution  to  a  concave  minimization  problem  with  linear  constraints. 

Let  i  G  {1,  2,  ...,  k),  where  1  <  k  <  q.  From  (4.25),  we  know  that  w  g  W(y')  if 
and  only  if  there  exist  a  vector  u'  >  0  and  a  vector  v'  >  0  such  that 

C^w  -(A')^u'  +  (E')V  =  0, 
where  A'  and  E'  are  matrices  determined  in  the  manner  explained  in  Section  4.3.1.  . 
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Now,  we  investigate  the  distance  from  a  given  point  w  to  the  set  W(y').  Consider 
the  problem 

min  d(w,  z)  =  w^w  -  2w^z  +  z^z 
s.t.  C'^z  -  (A')V  +  (E')V  =  0,        >.V 
u'>0,  v'>0,  '         ;  ■.'■■^ 

where  w  is  fixed  and  z,  u',  v'  are  variables.  This  is  a  convex  quadratic  programming 
problem.  By  using  the  Karush-Kuhn-Tucker  conditions,  we  see  that  (z',  u',  v')  is  an 
optimal  solution  to  this  problem  if  and  only  if  there  exists  a  vector  r'  g  R"  such  that  (z,  u', 
v',  r')  together  satisfy 

-2w  +  2z*  +  Cr' =0,  (4.34) 

CV  -  (A'f  u'  +  (E')V  =  0,  (4.35) 

(A't')V  =  0,  (4.36) 

(E't')V  =  0,  (4.37) 

A'r'  <0,  E'r'  >0,  (4.38) 

u'  >  0,  v'  >  0.  (4.39) 

Therefore,  for  a  given  w,  the  Euclidean  distance  squared  from  w  to  W(y')  equals  ||w-z'||^, 
where,  for  some  r',  u',  v',  (z',  u',  v',  t')  together  satisfy  (4.34)-(4.39).  Notice  that  w  0 

W(y')  if  and  only  if  the  Euclidean  distance  squared  from  w  to  W(y')  is  greater  than  zero. 

p 
This  holds  if  and  only  if  the  rectilinear  distance  from  w  to  z',  2]l  ^i  ~^\'  I'  '^  greater  than 

1=1 

zero.  Furthermore,  if  w,  z',  u',  v',  r'  together  satisfy  (4.34)-(4.39),  then  Mw,  Mz',  Mu', 

Mv',  Mr'  together  also  satisfy  (4.34)-(4.39),  where  M  is  any  positive  number. 
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The  observations  above  imply  that  to  seek  a  point  w  e  W''^'  =  W"  \  (J  W(y' ) ,  we 

may  instead  seek  a  point  w  that,  together  with  some  (z',  u',  v',  t'),  satisfies  (4.34)-(4.41) 
for  each  i  =  1,  2,  ...,  k,  where,  for  each  i  =  1,  2, ...,  k,  (4.40)  is  given  by 

f^\v,,-z;\>\,  .  (4.40) 

1=1 


and  (4.41)  is  given  by 

w  >e. 

For  eachi=  1,  2,...,  k  andl  =  1, 

2,. 

,P,  let 

(s,r={;'-^' 

if  W,-2,'>0, 

otherwise, 

/i  -  w, 

if  w,-z,'  >0^ 
otherwise. 

^,- 


V 


(4.41) 


Then,  for  each  i  =  1 ,  2, . . . ,  k, 

|w,  -  z,i  =  (s,r  +  (siT,  1=1,2,  ..,p,  (4.42) 

w,-z/  =  (s,r-(sir,  1=1,2,  ...,p,  (4.43) 

(s,r,(siT^O,  1=1,2,  ...,p,  (4.44) 

(s,r(siT  =  0,  1=1,2,  ...,  p.  (4.45) 

Notice  that  (4.42)  holds  if  w,  z\  (siV,  (s/)"  together  satisfy  (4.43)-(4.45).  Therefore,  for 
each  i  =  1,  2,...,k,  we  have  that  w,  z'  together  satisfy  (4.40)  if  and  only  if  there  exist  (si')^ 
and  (si')",  1  =  1,  2,  ...,  p,  that,  together  with  w  and  z'  satisfy  (4.43)-(4.45)  for  each  1=1,2, 
...,  p,  and  the  inequality 
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Z[(s;)'+(s,'n>i.  (4.46) 


1=1 


The  arguments  above  imply  that  to  solve  (4.34)-(4.41)  for  each  i  =  1,  2,  ...,  k,  we 
may  equivalently  solve  for  each  i  =  1,  2,  ...,  k  (4.34)-(4.39),  (4.41)  and  (4.43)-(4.46). 
Thus,  w  G  W*""'  if  and  only  if  there  exist  z',  u',  v',  r',  (si')\  (si')',  1  =  1,  2,  ...,  p,  and  a 
scalar  M  >  0  such  that  (Mw,  z',  u ,  v',  z' ,  {s'Y,  (s')  )  together  satisfy  (4.34)-(4.39),  (4,41) 
and  (4.43)-(4.46).  Notice  that  systems  of  (4.34)-(4.39),  (4,41)  and  (4.43)-(4,46),  i  =  1,  2, 
,,,,  k,  together  have  a  solution  if  and  only  if  the  following  single  objective  programming 
problem  (P)  has  an  optimal  solution  and  an  optimal  objective  function  value  of  zero. 


k       P 


(P)   min  (XZ(min{0,(s,')^-(s,')-}  +  (s,')-) 


=1  1=1 

k 


+  X   X(™"(0'-(A'^')i-u,'}  +  u,') 

>=1  lelEKx') 

+  2;   X(™n{0>(EV),-v,'}  +  v,')) 

i=l  l6l°(x') 


s.  t.     -2w  +  2z'  +  Cr' =0,    i=l,2,  ..,,k, 


C V  -  (A')^u'  +  (E') V  =  0,    i  =  1 ,  2,  . , .  ,k. 


A'r'  <0,  E'r'  >  0,    i=l,2,  ,,,,k, 

w,-z/  =  (s,y-(s,r,    l=l,2,.,,,p,  i=l,2,..„k, 

Z[is:r+is:r]>\,  i=i,2,,,„k, 

1=' 

(s,r,(s,r>o,  i=i,2,  .,.,k,  i=i,2,,..,p, 

u'>0,v'>0,    i=l,2,  ,,,,k, 
w>  e, 
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where,  for  each  i  =  1,  2,  ..,,  k,  A'  is  the  matrix  whose  rows  are  Aj,  jgID(x')  =  (j  g  (1,  2, 
...,  m}|  Ajx'  =  bj},  andE'  is  the  matrix  whose  rows  areEi,  le  I**(x')  =  { JG{l,2,.,.,n}|  x/  = 

0}. 

Remark  4.3.3.  It  is  obvious  that  the  objective  function  of  (P)  is  continuous  and 
concave.  Therefore,  problem  (P)  is  a  concave  minimization  problem  with  linear 
constraints.  Notice  further  that  problem  (P)  is  bounded  from  below.  Therefore,  it  follows 
from  Property  14  of  Benson  (1995b)  that  problem  (P)  has  at  least  one  global  optimal 
solution. 

Based  on  the  above  discussion  and  Remark  4.3.3,  we  immediately  have  the 
following  theorem. 

Theorem  4.3.8.  W*"^'  ^  0  if  and  only  if  the  optimal  value  of  problem  (P)  is  zero. 
Furthermore,  if  (w,  z',  u',  v',  r',  (s^,  (s')",  i  =  l,...,k)  is  an  optimal  solution  to  problem 
(P),  where  (s^  =  ((siT,  (SiT,  ...,  (SpT)  and  (s')  =  ((siT,  (S2T,  • -,  (SpT),  and  problem 
(P)  has  optimal  value  zero,  then  w  g  W'^^V 

Remark  4.3.4.  From  Remark  4.3.3,  problem  (P)  always  has  at  least  one  global 
optimal  solution.  Thus,  there  is  always  a  compact  polyhedral  subset  of  the  feasible  region 
of  problem  (P)  which  contains  at  least  one  global  optimal  solution  of  problem  (P).  In 
practice,  to  solve  problem  (P)  we  may  first  attempt  to  add  some  linear  constraints  to 
problem  (P)  to  form  an  alternative  problem  (P)  to  problem  (P).  The  feasible  region  of 
problem  ( P )  should  be  a  compact  polyhedral  subset  of  the  feasible  region  of  problem  (P) 
and  should  be  large  enough  to  contain  a  global  optimal  solution  of  problem  (P).  The 
alternative  problem  ( P )  is  a  concave  minimization  problem  over  a  compact  polyhedron. 
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We  caution,  however,  that  the  question  of  appropriately  forming  problem  (P)  from 
problem  (P)  calls  for  further  research.         .  >«  •        ,> 

Remark  4.3.5.  Notice  that  to  implement  STEP  3  of  BWSDA  via  problem  (P),  the 
size  of  problem  (P)  generally  increases  at  each  iteration.  In  particular,  for  any  k  g  {1,  2, 
...,  q-1},  in  passing  from  iteration  k  to  iteration  k  +  1,  if  problem  (P)  is  used  in  BWSDA, 
the  size  of  this  problem  increases  by  (3p  +  n  +  d)  variables,  where  d  is  an  integer  whose 
value  varies  and  depends  upon  the  difference  between  the  sum  of  the  number  of  rows  in 
A''^'  and  in  E''^^  and  the  sum  of  number  of  rows  in  A''  and  in  E''.  In  addition,  in  passing 
from  iteration  k  to  iteration  k+1,  if  problem  (P)  is  used  in  BWSDA,  the  number  of  terms 
in  the  objective  function  and  the  number  of  constraints  in  problem  (P)  increase  by  (p+d) 
and  (2p+n+d),  respectively.  These  observations  imply,  since  d  is  typically  zero,  that  in 
passing  from  iteration  k  to  iteration  k+1,  if  problem  (P)  is  used  in  STEP  3  of  BWSDA,  the 
size  of  problem  (P)  will  generally  increase.  Therefore,  it  is  especially  crucial  to  choose  the 
most  efficient  algorithm  available  for  globally  solving  the  concave  minimization  problem 
(P)  (or  (  P ))  if  this  problem  is  to  be  used  to  implement  STEP  3 . 

Remark  4.3.6.  There  are  many  algorithms  available  for  globally  solving  concave 
minimization  problems  over  polyhedra.  For  reviews  and  discussions  of  these  algorithms, 
see,  for  instance,  Benson  (1995b,  1996),  Horst  (1984),  Horst  and  Tuy  (1993),  and 
Pardalos  and  Rosen  (1986).  The  question  of  which  of  these  algorithms  would  be  most 
efficient  for  solving  problem  (P)  depends  upon  many  factors,  including  the  approach  that 
we  choose  to  solve  problem  (P).  There  are  at  least  three  approaches  for  globally  solving 
problem  (P). 
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One  approach  is  to  solve  problem  (P)  directly.  This  would  involve  minimizing  a 

nonseparable,  continuous  concave  function  over  an  unbounded  polyhedron.  Many  of  the 

available  concave  minimization  methods  that  solve  problems  with  polyhedral  feasible 

regions  require,  as  stated,  that  the  feasible  region  be  bounded  (c.f ,  e.g.,  Horst  and  Tuy, 

1993).  However,  some  of  these  methods  can  and  have  been  extended  to  problems  with 

unbounded   polyhedral   feasible   regions.    Included   among   these   methods   are    some 

algorithms  that  use  outer  approximation,  polyhedral  annexation,  branch  and  bound  via 

•  "  -if" 
conical  subdivision,  and  branch  and  bound  via  simplicial  subdivision.  For  explanations  and 

discussions  of  these  algorithms,  an  excellent  source  is  Horst  and  Tuy  (1993). 

As  mentioned  in  Remark  4.3.4,  a  second  approach  for  globally  solving  problem  (P) 
is  potentially  available  which  adds  linear  constraints  to  the  feasible  region  of  problem  (P). 
These  constraints  would  be  added  in  such  a  way  that  the  new  feasible  region  would 
become  a  bounded  polyhedron  and  would  contain  at  least  one  global  optimal  solution  to 
problem  (P).  The  new  problem  (P)  thereby  created  would  be  potentially  globally  solvable 
by  numerous  concave  minimization  methods  designed  for  solving  problems  with  bounded, 
polyhedral  feasible  regions  (c  f  Benson,  1995b,  1996;  Horst,  1984;  Horst  and  Tuy,  1993;, 
Pardalos  and  Rosen,  1986,  and  references  therein).  However,  as  noted  in  Remark  4.3.4, 
the  process  of  developing  a  means  of  creating  problem  ( P )  from  problem  (P)  calls  for 
further  research. 

A  third  approach  for  globally  solving  problem  (P)  is  to  use  a  technique  of  Bard  and 
Falk  (1982)  to  transform  the  objective  function  of  problem  (P)  into  a  sum  of  concave 
functions  of  one  variable  each.  The  new  concave  objective  function  created  in  this  way  is 
called  separable.  This  transformation  would  increase  the  size  of  problem  (P).  But  it  would 
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also  potentially  allow  for  more  efficient  solution  of  the  problem  via  various  specialized 
concave  minimization  algorithms  designed  for  handling  separable  objective  functions. 
Among  such  algorithms  are  those  of  Benson  (1990),  Falk  and  Soland  (1969),  Shectman 
and  Sahinidis  (1998),  and  Soland  (1974),  for  example.  However,  these  algorithms  would 
need  to  be  modified  to  handle  unbounded  feasible  regions. 

From  Remarks  4.3.4  through  4.3.6,  we  see  that  there  are  many  potential  concave 
minimization  approaches  and  algorithms  for  solving  problem  (P).  If  problem  (P)  were  to 
be  globally  solved  to  implement  each  iteration  of  STEP  3  of  BWSDA,  it  is  particularly 
important  to  choose  the  most  efficient  approach  and  algorithm  available.  This  is  because, 
in  practice,  problem  (P)  can  potentially  be  a  large-scale  problem.  Furthermore,  as 
mentioned  in  Remark  4.3.5,  the  size  of  problem  (P)  generally  will  increase  from  one 
iteration  to  the  next  of  BWSDA  if  it  is  used  to  implement  STEP  3  of  this  algorithm. 
Clearly,  there  are  many  options,  but  also  some  obstacles,  in  attempting  to  globally  solve 
problem  (P).  It  is,  in  part,  because  of  this,  that  the  questions  of  whether  or  not  problem 
(P)  can  be  reasonably  solved  in  practice,  and,  if  so,  by  what  method  or  methods,  remain 
open  questions. 

If  problem  (P)  is  used  to  find  a  point  w  e  W''^'  or  to  determine  that  W*""^'  =  0  in 
STEP  3  of  BWSDA,  we  obtain  the  following  algorithm,  which  we  call  the  Weight  Set 
Decomposition  Algorithm-  II  (WSDA-  II). 
Weight  Set  Decomposition  Algorithm-  II  (WSDA-  II) 

STEP  1.     Set  W'  =  W*^.  Choose  any  point  w'  g  W\  Find  any  optimal  extreme  point 
solution  x'  to  problem  LP(w').  Set  k  :=  1,  EX°  :=  0,  EY*  :=  0. 
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STEP  2.     If  X  is  the  unique  optimal  solution  to  problem  LP(w  ),  then  set  x  =  x  and  y 
==  CxV  Otherwise,  find  x''  and  y''  by  using  Subprocedure  I.  Next,  set  EX^  = 
EX"-'  u{x'},  EY"  =  EY'-'  uly'land  W'"'  =  W'\W(y'). 

STEPS.  Solve  the  concave  minimization  program  (P)  for  a  global  optimal  solution. 
Suppose  that  (w,  z',  u',  v',  r',  (s')\  (s')",  i  =  l,...,k)  is  a  global  optimal  solution 
for  problem  (P).  If  the  global  optimal  value  equals  zero,  let  w'''^'  =  w,  and  go  to 
STEP  4.  Otherwise,  stop;  YexO  Ye  -  EY\ 

STEP  4.     Find  any  optimal  extreme  point  solution  x''*'  to  problem  LP(w'''^').  Set  k  :== 
k+1  and  go  to  STEP  2. 
To  illustrate  the  Weight  Set  Decomposition  Algorithms,  we  will  use  WSDA-I  to 

solve  the  bi-objective  programming  problem  given  in  Example  4.2.1. 

Example  4.3.1.  Consider  the  bi-objective  programming  problem  given  in  Example 

4.2. 1 .  The  data  is  as  follows. 


1       2     0 
-2     0     0 


and 

X={xGR^|Ax<b,  x>0}. 
We  demonstrate  the  step-by-step  computations  needed  to  solve  this  problem  with 
the  WSDA-I  algorithm. 
k=I: 


'2     0     1' 

6' 

,A  = 

-1    3     0 
-1     1     0 

,b  = 

6 

2 

0      0     1 

_2_ 
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STEP  1.  We  choose  w'  =  (1,  1)^.  Solving  problem  LP(w'),  we  obtain  an  optimal 
solution  x'  =  (0,  2,  Of . 

STEP  2.  Since  x'  is  not  the  unique  optimal  solution  of  problem  LP(w'),  we  need 
to  find  an  extreme  point  y'  of  Y  n  {y  |  (w')^  =  (w^)^Cx'  }.  By  using  the 
procedure  in  Section  3,  we  obtain  y'  =  (4,  0)^  and  x'  =  (0,  2,  0)^.  By 
using  the  simplex  tableau  for  problem  LP(w')  at  x\  we  obtain  D'(l)  =  { 
(0,  -2,  Of,  (0,  0,  2)'',  (3,  1,  of'}.  Thus,  we  set  EX'  :=  {x'},  EY^  :=  {y^}. 

STEP3.  j  =  l: 

3.1.  Since  k  =  1,  let  L,  =  D'(l).  Then  M  =3.  Set  j  ~  1. 

3.2.  Choose  p'  =  (0,-2,  of  gLi. 

3.3.  Solve  the  linear  system 


Iw'Cp'  >1, 
[w>l. 

This  system  has  no  solution.  Since  j  =  1  <  3  =  M,  set  Li  := 
Li\{p'}  =  {(0,  0,  2)\  (3,  1,  Of}.  Set j:=  j  +  1=2. 

3.2.  Choose  p^  =  (0,0,  2)'  eLi. 

3.3.  Solve  the  linear  system 

jw^Cp'  >1, 
|w>l. 

This  system  also  has  no  solution.  Since  j  =  2  <  3  =  M,  we  set  Li 
L,\{p'}  =  {(3,  l,0f}.Setj:=j  +  l=3. 
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3.2.  Choose  p^  =  (3,  1,  Of  e  L,. 

3.3.  Solve  the  linear  system 

Jw^Cp'>l, 

[w>l. 

We  obtain  a  feasible  solution  w*  =  (2,  1)^.  Set  w^  =  w*  =  (2, 
1)^.  Go  to  STEP  4. 
STEP  4.  Solving  LP(w^),  we  obtain  an  optimal  solution  x^=  (3,  3,  0)"^.  Set  k  :=  k 
+  1  =  2.  Go  to  STEP  2.     ■       ' 
k  =  2: 

STEP  2.  Since  x^  is  the  unique  optimal  solution  of  problem  LP(w^),  we  have  x  = 
x^  =(3,3,  0)^  and  y^  =  Cx^  =  (9,  -6)^.  By  using  the  simplex  tableau  for 
problem  LP(w')  at  x',  we  obtain  D'(2)  =  {(-3,  -1,  0)\  (-1,  -1/3,  if,  (0,  - 
3,  of).  Next,  we  set  EX'  :=  (x',  x'},  EY^  :=  {y',  y^} .  Go  to  STEP  3 . 
STEP3.j  =  l: 

3.1.  Since  k  =  2,  let  L2  =  {(z',  z^)|  z'  e  L,,  z^  g  D'(2)},  where  L, 
:={(3,  1,  0)^}.  ThenM=3.  Setj  :=  1. 

3.2.  Choose p'  =  (x',  x')gL2  with  x'  =(3,  1,0)^  gLi  and  x' = 
(-3,-l,0f  gD'(2). 

3.3.  Solve  the  linear  system 

jw^Cx'  >l,i-l,2 
1       w>l. 

This  system  has  no  solution.  Since  j  =  1  <  3  =  M,  set  L2  := 
L2\{p'}.Setj:=j  +  l-2. 
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3.2.  Choose  p^  =  (x',  x')GL2with  x'  =(3,  1,  0)'  g  Li  and  x'  - 
(-1, -1/3,  2f  e  D'(2). 

*         7 

3.3.  Solve  the  linear  system 
fw^Cx' >l,i=l,2       ■:::- 


*>  *         *  >  ■ 


w>l.  -■    •        .      . 

This  system  has  no  solution.  Since  j  =  2  <  3  =  M,  set  L2  := 
L2\{p'}  =  {((3,  1,  of,  (0,  -3,  Of)}.  Set j:=  j  +  1=3. 

3.2.  Choose  p'  =  (x',  x')GL2with  x'  =(3,  1,  Of  g  Li  and  x'  = 
(0,  -3,  Of  G  D'(2). 

3.3.  Solve  the  linear  system 

Jw^'Cx' >l,i=l,2 

[       w  >  1 . 

This  system  has  no  solution.  Since  j  =  3  =  M,  stop.  We  have 

found  the  set  of  all  efficient  extreme  points  in  the  outcome 

space,  which  is  Y^,  n  Ye  =  EY'  =  {y\  y"}  =  {(4,  of ,  (9,  -6f }. 

The  above  Example  4.3.1  stops  in  iteration  2  with  EY^  =  {(4,  0)^,  (9,  -6f }.  From 

Example  4.2.1,  we  know  that  Yex  n  Ye  =  ((4,  Of,  (9,  -6f }.  The  example  illustrates  that 

the  WSDA-I  is  finite  and  generates  an  unexplored  efficient  extreme  point  at  each  iteration 

of  STEP  2.  When  the  algorithm  stops,  it  has  generated  the  set  Yex  '^  Ye.  In  the  example, 

the  most  challenging  computations  involve  solving  linear  programs  and  linear  inequahty 

systems,  and  solving  the  neighborhood  problem.  This  illustrates  that  WSDA-I  can  be 
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implemented  by  using  linear  programming  methods.  From  Example  4.2.1,  the  efficient 
extreme  point  x'  is  degenerate.  However,  since  the  decomposition  of  the  weight  set  in 
WSDA-I  is  based  on  efficient  extreme  points  in  the  outcome  space,  this  did  not  cause 
WSDA-I  to  have  the  difficulties  that  Zeleny's  decision  space-based  decomposition 
algorithm  would  have  encountered  (see  Zeleny  ( 1 974)). 


4.4.  Discussion  .    i 

In  this  chapter,  we  have  presented  an  outcome  space-based  decomposition  of  the 
weight  set  W^.  Based  in  part  upon  this  decomposition,  we  have  developed  the  Basic 
Weight  Set  Decomposition  Algorithm  (BWSDA)  for  finding  the  set  of  all  efficient  extreme 
points  in  the  outcome  space  of  problem  MOLP.  By  using  two  different  kinds  of 
approaches  for  implementing  STEP  3  of  BWSDA,  we  obtained  two  versions  of  BWSDA, 
WSDA-I  and  WSDA-II  The  two  algorithms  are  finite  and  exact. 

In  Zeleny  (1974),  Zeleny  presented  a  decision  space-based  decomposition  of  the 
weight  set  W**.  Based  on  this  decomposition,  Zeleny  gave  two  strategies  for  developing 
algorithms  for  finding  the  set  of  all  efficient  extreme  points  in  the  decision  space  (see, 
Section  2.4,  Zeleny  (1974)).  For  convenience,  we  call  the  algorithms  based  on  these 
strategies  Zeleny's  decomposition  algorithms. 

Although  our  algorithms  and  Zeleny's  decomposition  algorithms  are  all  based  in 
part  on  the  decomposition  of  the  weight  set  W^,  they  are  quite  different.  Two  major 
differences  are  as  follows. 
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One  major  difference  is  that  our  algorithms  and  Zeleny's  algorithms  are  based  on 
different  decompositions  of  the  weight  set.  The  algorithms  WSDA-I  and  WSDA-II  are 
based  on  the  outcome  space-based  decomposition  of  the  weight  set,  while  Zeleny's 
decomposition  algorithms  are  based  on  the  decision  space-based  decomposition  of  the 
weight  set. 

The  other  major  difference  is  that  our  algorithms  and  Zeleny's  algorithms  work  in 
different  spaces.  The  algorithms  WSDA-I  and  WSDA-II  work  in  the  outcome  space  and 
find  the  set  of  all  efficient  extreme  points  in  the  outcome  space.  Zeleny's  decomposition 
algorithms  work  in  the  decision  space  and  try  to  find  the  set  of  all  efficient  extreme  points 
in  the  decision  space. 

Because  of  these  differences  and  other  factors,  our  algorithms  have  some  potential 
advantages  over  Zeleny's  decomposition  algorithms  and  over  other  vector  maximization 
algorithms  for  problem  MOLP  We  summarize  some  of  these  advantages  as  follows. 

(a)  The  algorithms  WSDA-I  and  WSDA-II  are  finite  and  exact,  and  work  in  the 
outcome  space  R"*,  rather  than  in  the  decision  space  R"  of  problem  MOLP  As  a  result, 
WSDA-I  and  WSDA-II  have  all  of  the  general  potential  advantages  of  outcome  space- 
based  algorithms  over  decision  space-based  algorithms  (c.f  Section  1.2).  - 

(b)  As  we  mentioned  in  Section  4.1,  there  are  two  major  difficulties  in 
implementing  Zeleny's  decomposition  algorithms.  Both  of  these  difficulties  arise  because 
in  decision  space  there  is  not  a  one-to-one  correspondence  between  efficient  bases  and 
subsets  of  the  weight  set  W°.  However,  WSDA-I  and  WSDA-II  do  not  encounter  these 
two  difficulties.  This  is  because  they  are  based  on  the  outcome  space-based  decomposition 
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of  the  weight  set,  which  establishes  a  one-to-one  correspondence  between  the  efficient 
extreme  points  in  the  outcome  space  and  corresponding  subsets  of  the  weight  set. 

(c)  Unlike  typical  decision  space-based  procedures  for  finding  the  set  of  all 
efficient  extreme  points  in  the  decision  space,  the  WSDA-I  and  WSDA-II  do  not  call  for 
using  special,  complicated  bookkeeping,  backtracking,  or  degeneracy  schemes. 

(d)  The  most  difficult  task  in  each  of  the  algorithms  WSDA-I  and  WSDA-II  is  to 
find  a  new  weight  vector  in  each  iteration  that  leads  to  an  unexplored  efficient  extreme 
point  in  the  outcome  space,  if  there  exists  such  a  vector.  The  difference  between  the  two 
algorithms  is  the  way  in  which  this  task  is  accomplished.  In  algorithm  WSDA-I,  an 
intelligent  tree  search  method  accomplishes  this  task.  This  method  requires  solving  a  finite 
number  of  linear  inequality  systems.  In  algorithm  WSDA-II,  this  task  is  accomplished  by 
globally  solving  a  concave  minimization  problem  over  a  polyhedron.  As  mentioned  earlier, 
there  are  many  potential  approaches  and  algorithms  available  for  solving  this  kind  of 
concave  minimization  problem,  The  goal  is  to  tailor  the  concave  minimization  approach 
and  algorithm  used  in  WSDA-II  to  efficiently  solve  this  problem,  if  possible.  Since  this 
problem  can  be  large  scale  and  generally  grows  in  size  from  iteration  to  iteration  of 
WSDA-II,  it  is  especially  critical  to  make  this  choice  wisely. 

In  Benson  (1998a,  1998c),  two  other  outcome  space-based  algorithms  are  given 
for  finding  the  set  of  all  efficient  extreme  points  in  the  outcome  space  of  problem  MOLP. 
The  two  algorithms  of  Benson  have  many  potential  advantages  (see  Benson  (1998a, 
1998c)).  Because  of  their  advantages,  these  two  algorithms  may  also  prove  to  be  suitable 
for  solving  large-scale  multiple  objective  linear  programming  problems.  However,  since 
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the  Benson  algorithms  and  our  algorithms  use  different  kinds  of  techniques,  they  each  may 
be  usefiil,  but  for  different  kinds  of  MOLP  problems. 


4.5.  Concluding  Remarks 

Quite  a  few  algorithms  have  been  developed  for  finding  the  set  of  all  efficient 
extreme  points  of  a  multiple  objective  linear  programming  problem  in  decision  space. 
Although  these  algorithms  are  quite  different  in  certain  ways,  they  all  utilize  some 
modified  version  of  the  simplex  method.  Because  of  the  complexity  of  these  algorithms 
and  the  sheer  size  of  the  set  Xe  n  Xex,  these  algorithms  have  achieved  only  limited  success 
in  practice. 

Recently,  some  researchers  have  begun  to  develop  tools  for  generating  the  set  of 
all  efficient  extreme  points  in  the  outcome  space.  Two  algorithms  have  been  developed  by 
Benson  (1998a,  1998c)  that  use  the  outer  approximation  technique  of  global  optimization. 
However,  since  the  two  algorithms  of  Benson,  to  our  knowledge,  are  the  only  two 
outcome  space  based  algorithms  that  are  capable  of  generating  the  set  of  all  efficient 
extreme  points  of  a  general  MOLP  problem,  and  since  we  do  not  know  how  well  these 
two  algorithms  will  work,  we  need  to  develop  and  explore  more  new  outcome  space- 
based  algorithms.  ■  ■■  '■'■'' 

In  this  chapter,  we  have  developed  a  new  class  of  outcome  space-based 
decomposition  algorithm,  BWSDA,  for  finding  the  set  of  all  efficient  extreme  points  in  the 
outcome  space  of  a  multiple  objective  linear  program.  Based  on  two  different  kinds  of 
implementations  of  one  of  the  key  steps  of  algorithm  BWSDA,  we  obtained  two  versions 
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of  algorithm  BWSDA,  called  algorithm  WSDA-I  and  algorithm  WSDA-II.  These  two 
algorithms  are  finite  and  exact.  They  both  work  in  the  outcome  space.  As  a  resuh,  they 
have  some  potential  advantages  over  decision  space-based  algorithms.  Algorithm  WSDA-I 
uses  linear  programming  methods,  and  algorithm  WSDA-II  uses  linear  programming  and 
concave  minimization.  They  both  may  have  the  potential  to  solve  large-scale  multiple 
objective  linear  programs.  Their  ability  to  do  so  remains  a  topic  for  further  research. 


CHAPTERS 
FINDING  THE  EFFICIENT  OUTCOME  SET  OF  PROBLEM  MOLP 


As  we  mentioned  in  Chapter  4,  a  multiple  objective  linear  programming  problem 
(MOLP)  can  be  written  as  follows: 

MOLP:  v-max  Cx 

s.t.     Ax<b  ■"     ^  . 

X>0,  "';        V  " 


Jtr 


where  C  e  R""",  A  e  R""",  b  e  R".  Let 

..:'  '       X={xgR"|  Ax<b,x>0},  •■ 

and  let  ' 

Y=(Cx|xgX}. 

Then  the  corresponding  problem  of  problem  (MOLP)  in  the  outcome  space  is  as  follows 

ji^    .  MOLPY:    v-max  y  '   , 

s.t.  y  G  Y.  ...  !'■ 

In  Chapter  4,  we  presented  an  algorithm  for  finding  the  set  of  all  efficient  extreme 
points  in  the  outcome  space  of  problem  (MOLP),  or  the  set  of  all  efficient  extreme  points 
of  problem  (MOLPY).  In  this  chapter,  we  will  present  an  algorithm  for  finding  the  entire 
efficient  outcome  set  of  problem  (MOLP). 

The  rationale  for  generating  the  set  of  all  efl5cient  points  for  problem  MOLP  in  the 
outcome  space  is  that  none  of  the  efficient  extreme  points  in  the  outcome  space  may  be  an 
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acceptable  approximation  of  a  most  preferred  solution  of  the  DM  in  outcome  space.  As  a 
result,  we  may,  in  some  cases,  need  to  generate  the  entire  efficient  set. 

For  convenience,  we  will  use  the  same  notation  as  in  Chapter  4  for  the  decision 
set,  the  outcome  set,  the  efficient  decision  set,  the  efficient  outcome  set  and  the  set  of  all 
efficient  extreme  points  of  problem  MOLP. 

This  chapter  is  organized  in  the  following  way.  In  Section  5.1,  we  give  some 
necessary  preliminaries.  Section  5.2  contains  the  necessary  theoretical  background  for  the 
algorithm.  The  algorithm  for  finding  the  efficient  outcome  set  is  given  in  Section  5.3. 
Finally,  some  concluding  remarks  are  given  in  Section  5.4. 


5.1.  Preliminaries 

Throughout  this  chapter  we  will  assume  that  the  decision  set  X  of  problem  MOLP 
is  nonempty  and  compact.  It  follows  that  the  outcome  set  Y  of  problem  MOLP  is 
nonempty  and  compact. 

In  the  following,  we  will  give  some  definitions  that  will  be  used  in  this  chapter.  All 
of  our  standard  definitions  from  convex  analysis  are  taken  from  Rockafellar  (1970)  and 
Brondsted  (1983). 

Let  S  be  a  nonempty  set  in  R**.  S  is  called  a  cone  if  for  each  vector  s  in  S  and  each 
real  number  A.  >  0  A,s  is  in  S. 

Let  a  ;^  0  be  a  vector  in  R'',  and  let  bo  be  a  real-valued  number  in  R.  Then,  the 
hyperplane  defined  by  a  and  bo  is  the  set 

{yeR''|a^y==bo}, 
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which  is  denoted  by  H(a,  bo).  The  closed  half-space  defined  by  a  and  bo  is 

{y  sR"!  a^'y  ^  bo }, 
and  is  denoted  by  H  (a, bo).  ' 

Let  Z  be  a  nonempty  convex  set  in  R''.  H(a,  bo)  is  called  a  supporting  hyperplam 
of  Z  if  Z  e  H~  (a,  bj  and  there  is  at  least  one  y*  g  Z  n,  H(a,  bo).  This  hyperplane  H(a,  bo) 
is  also  called  a  ^/?/?o/-//«^ /2y/?e;r/7/a/2e  of  Z  a/ y*. 

Suppose  that  Z  is  a  nonempty  convex  set  in  R""  and  z*  g  Z.  Then  Z  is  said  to  be  of 
dimension  f  if  the  maximum  number  of  linearly  independent  vectors  in 

{(z -z*)  e  RP|  z  G  Z  } 

i     '     "    -^  '      '         ;     ,  V      •«         -y    .     ^         ''',<• 

»/  .  ....      . 

Assume  that  Z  is  a  nonempty  convex  set  in  R''.  If  F  e  Z  c  R"*  and  F  ;t  0,  then  F  is 

called  an  exposed  face  of  Z  if  there  exists  a  supporting  hyperplane  H(a,  bo)  of  Z  such  that 

H(a,  bo)nZ  =  F. 

Furthermore,  F  is  called  anf-face  of  Z  if  F  is  an  exposed  face  of  Z  and  is  of  dimension/ 

If  F  is  an /-face  of  Z,  then,  F  is  called  a  maximal  exposed  face  if  there  does  not 

exist  a  g-face  G  of  Z  such  that  F  e  G  and/<  g. 


5.2.  Theoretical  Background 

Let  y*  be  an  extreme  point  of  the  outcome  set  Y  of  problem  MOLP.  Then,  from 
Proposition  4.2.2,  cone  (Y-{y*})  and  W(y*)  are  polyhedral  cones  and  are  polar  to  one 
another.  In  the  following,  we  will  discuss  some  relationships  between  the  exposed  faces  of 
cone  (Y-{y*})  and  the  exposed  faces  of  W(y*),  and  some  relationships  between  the 


117 

exposed  faces  of  Y  and  the  exposed  faces  of  cone  (Y-{y*}).  Based  upon  these 
relationships,  if  y*  is  also  an  efficient  point,  we  will  present  a  theorem  that  can  be  used  for 
finding  all  maximal  efficient  faces  containing  y*.  Our  algorithm  for  finding  the  entire 

efficient  outcome  set  will  be  based  upon  this  theorem.  ,  ^. 

'•■»■  i 

Let  F  be  an  exposed  face  of  cone  (Y-{y*}).  Define 

*(■ 

F^=  f|{weW(y*)|w^z  =  0}. 

zeF 

Notice  that  the  origin  is  in  W(y*).  It  follows  from  the  definition  that  the  origin  is  in 
F'^ .  So,  F'^  is  always  nonempty.  In  the  following,  we  first  prove  a  very  useful  theorem 
that  characterizes  the  set  F^ . 

Theorem  5.2.1.  Let  F  be  an  exposed  face  of  cone  (Y-{y*}).  Then  w  g  F'^  if  and 
only  if  H(w,  0)  =  (z  g  R""!  w^z  =  0}  is  a  supporting  hyperplane  of  cone  (Y-{y*})  at  the 
origin  and  F  c  H(w,  0). 

Proof  Necessity.  Suppose  that  we  F^ .  By  the  definition  of  F'^ ,  we  have  w  e 
W(y*)  and  w^z  =  0  for  any  z  e  F.  From  w  g  W(y*),  we  have  w^(y-y*)  <  0  for  any  y  g  Y; 
hence,  w'^z  <  0  for  any  z  g  cone  (Y-{y*}).  It  follows  that  cone  (Y-{y*})  e  H"(w,  0)  = 
(zgR*"!  w^z  <  0}.  So,  H(w,  0)  is  a  supporting  hyperplane  of  cone  (Y-{y*})  at  the  origin. 
Since  w^z  =  0  for  any  z  g  F,  we  have  F  c  H(w,  0). 

Sufficiency.  Suppose  H(w,  0)  is  a  supporting  hyperplane  of  cone  (Y-{y*})  at  the 
orign  with  F  c  H(w,  0).  Since  H(w,  0)  is  a  supporting  hyperplane  of  cone  (Y-{y*})  at  the 
orign,  w^z  <  0  for  any  z  e  cone  (Y-{y*}),  So,  w^z  <  0  for  any  z  g  Y-{y*}.  It  follows  that 
w^(y-y*)  <  0  for  any  y  g  Y.  This  implies  that  w  g  W(y*).  Since  F  c  H(w,  0),  w^z  =  0  for 
any  z  g  F.  Consequently,  w  g  F^  .  D 
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Now,  we  prove  that  F^  is  an  exposed  face  of  W(y*). 

Theorem  5.2.2.  Let  F  be  an  exposed  face  of  cone  (Y-{y*}).  Then  F^  is  an  exposed 
face  of  W(y*). 

Proof  First,  we  prove  that,  for  a  given  z  e  F,  H(z°,  0)  =  {w  g  R^I  wV  =  0}  is  a 
supporting  hyperplane  of  W(y*)  at  some  point  w'  g  W(y*),  where  w'  *■  0. 

Since  z"  e  F  c  cone  (Y-{y*}),  there  exists  a  scalar  t  >  0  and  a  point  y"  e  Y  such 
that 

z''  =  t(yV).      . 
For  any  w  g  W(y*),  it  follows  from  the  definition  of  W(y*)  that 

w%-y*)  <  0  for  all  y  G  Y. 
Since  y°  g  Y  and  t  >  0,  this  implies  that 

w'^z"  =  w^'CtCy^-y*))  <  0. 
Therefore, 

W(y*)c  H"(z°,0).  (5.1) 

Since  F  is  an  exposed  face  of  cone  (Y-{y*}),  we  may  choose  a  point  W  i^^  and  a 
scalar  P  such  that 

F  =  cone  (Y-{y*})  r^  H(w',  p),  (5.2) 

and 

cone(Y-{y*})e  H  (w',/?).  (5.3) 

Let  z'  G  F.  By  (5.2),  z'  g  H(w',  p)  and  z'  g  cone  (Y-{y*}).  Since  z'  g  H(w',  p),  w''^z'  =  p. 
By  definition  of  a  cone,  because  z'  g  cone  (Y-{y*}),  it  follows  that  t'z'  g  cone  (Y-{y*}) 
for  any  t'  >  0.  From  w'V  =  P  and  (5.3),  this  implies  that 
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t'p  =  w-'^Cfz')  <  P  foranyt'>0. 
By  choosing  t'  =  0  and  t'  =  2,  we  see  that  (3  =  0. 

Since  z"  e  F,  it  follows  from  (5.2)  and  from  p  =  0  that 

w'V  =  0.  (5.4) 

This  implies  that  w'  g  H(z°,  0).  Furthermore,  using  (5.3),  since  p  =  0,  it  is  easy  to  show 
that  w'  6  W(y*).  Together  with  (5.1),  the  latter  two  sentences  imply  that  U(z°,  0)  is  a 
supporting  hyperplane  of  W(y*)  at  the  nonzero  point  w'  g  W(y*). 

Notice  that  the  argument  above  implies  that  for  each  z°  e  F,  the  hyperplane  H(z'', 
0)  is  a  supporting  hyperplane  of  W(y*)  at  some  point  in  W(y*).  Thus,  for  each  z  e  F, 
H(z'',  0)  r^  W(y*)  is  an  exposed  face  of  W(y*).  Since  F''=  p|(W(y*)nH(z,0)),  it 

zeF 

follows  from  Theorem  5  9  of  Brendsted  (1983)  that  F'^  is  also  an  exposed  face  of 
W(y*).  D 

Since  F'^  is  an  exposed  face  of  W(y*),  we  can  define  F'^=  (F'^)'^ ,  where 

(F^)A  =   p|(zgcone(Y-{y*))|w^z  =  0}.  (5.5) 

We  have  the  following  theorem. 

Theorem  5.2.3.  Let  F  be  an  exposed  face  of  cone  (Y-{y*}).  Then  F'^=  F. 
Proof  Since  F^=  (F^)\  by  (5.5) 

F^=  fl{zGcone(Y-{y*})|w^z-0}.  (5.6) 

From  Theorem  5.2.1,  w  e  F^  if  and  only  if  H(w,  0)  =  {z  e  R*"]  w^z  =  0}  is  a  supporting 
hyperplane  of  cone  (Y-{y*})  and  F  c  H(w,  0).  Therefore,  w  e  F'^  if  and  only  if  {z  e  cone 


,;•«!,. 
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(Y-{y*})|  w'^z  =  0}  is  an  exposed  face  of  cone  (Y-{y*})  containing  F.  From  (5.6)  this 
implies  that  F^is  the  intersection  of  all  exposed  faces  of  cone  (Y-{y*))  containing  F. 
Notice  that,  by  assumption,  F  is  also  an  exposed  face  of  cone  (Y-{y*})  containing  F. 
Thus,  the  above  intersection  is  simply  F  itself  ^   '  D 

From  Theorem  5.2.2,  for  any  exposed  face  F  of  cone  (Y-{y*}),  there  is  a 
corresponding  exposed  face  F^of  W(y*).  From  Theorem  5.2.3,  for  any  exposed  face 
F'^of  W(y*),  there  is  a  corresponding  exposed  face  F  =  F'^of  cone  (Y-{y*}). 
Furthermore,  it  follows  immediately  from  Theorems  5.2.2  and  5.2.3  that  F^  and  F^  are  two 
different  exposed  faces  of  cone  (Y-{y*})  if  and  only  if  (F')^  and  (F^f  are  two  different 
exposed  faces  of  W(y*).  Thus,  Theorems  5.2.2  and  5.2.3  establish  a  one-to-one 
correspondence  between  the  exposed  faces  of  cone  (Y-{y*})  and  the  exposed  faces  of 

w(y*).  "  "    .  y,  ':.    ■..,■' 

We  call  the  exposed  face  F'^of  W(y*)  the  conjugate  face  (  see,  e.g.  Br0ndsted      ,v 
(1983) )  of  F,  where  F  is  an  exposed  face  of  cone  (Y-{y*)). 

Remark  5.2.1.  Let  F  be  an  exposed  face  of  cone  (Y-{y*}).  From  Theorem  5.2.3, 
we  have  that 

F  -  cone  (Y-{y*})  n  (  f|{z  |  w^z  =  0}),  "     ■  V;  (5.7)      ''■'^ 


W£F" 


and,  for  each  w  e  F'^ , 

Fecone(Y-{y*})n{z|w^z  =  0}.  (5.8) 

The  following  result  shows  that  the  reverse  inclusion  in  Remark  5.2.1  holds  when 
F  is  a  maximal  exposed  face  of  cone  (Y-{y*}). 
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Theorem  5.2.4.  If  F  is  a  maximal  exposed  face  of  cone  (Y-{y*}),  then,  for  each  w 

eF\ 

F  =  cone  (Y-{y*})  n  {z|  w'^z  =  0}. 

Proof  From  Remark  5.2.1,  F  c  cone  (Y-{y*})  r^  {z|  w'^z  =  0}  for  each  w  e  F'^ . 
Let  w  G  F'^ .  Notice  that  C  =  cone  (Y-{y*})  n  {z|  w^z  =  0}  is  an  exposed  face  of  cone 
(Y-{y*}).  Since  F  c  C  and  F  is  a  maximal  exposed  face,  this  implies  that  F  =  C  =  cone  (Y- 
{y*})r^  {zlw'^z^O}.  0 

Now,  we  discuss  some  relationships  between  the  exposed  faces  of  Y  and  the 
exposed  faces  of  cone  (Y-{y*}).  -  '     ■ 

Theorem  5.2.5.  Let  F  be  an  exposed  face  of  cone  (Y-{y*}).  Then 

(a)  If  F  is  an/-face  of  cone  (Y-{y*}),  then  (F  +  {y*})  n  Y  is  a/-face  of  Y. 

(b)  If  F  is  a  maximal  exposed  face  of  cone  (Y-{y*}),  then  (F  +  {y*})  n  Y  is  a 
maximal  exposed  face  of  Y. 

Proof  (a)  Since  F  is  an  exposed  face  of  cone  (Y-{y*}),  it  follows  from  the  proof 
of  Theorem  5.2.2  that  there  exists  a  supporting  hyperplane  H(w',  0)  of  cone  (Y-{y*}) 
such  that 

cone(Y-{y*})nH(w',  0)  =  F,  "'      (5.9) 

and  ■  '■'--  :-^  '\ 

cone(Y-{y*})Q  H  (w',0).  (5.10) 

By  (5.10),  we  have  Y-{y*}c  H" (w',  0) .  This  implies  that 

Yc  H  (w'.w'^'y*). 

Therefore,  H"(w',  w'^  y*)  is  a  supporting  hyperplane  of  Y  at  y*  g  Y. 
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We  will  now  show  that 

(F  +  {y*})nY=  H(w',w'^y*)nY.  (5.11) 

Towards  this  end,  let  y  g  (F  +  {y*})  n  Y.  Then,  there  exists  z  e  F  such  that  y  =  z  +  y*. 
By  (5.9),  w''^z  =  0.  Therefore, 

w'^^y  =  w'\*; 

i.e.  y  G  H(w',  w'^  y*) .  As  a  result, 

(F+{y*})nYe  H(w',w'^y*)nY.  (5.12) 

Assume  now  that  y  g  H(w',  w''  y*)n  Y,  and  let  z  =  y  -  y*.  Then,  since  y  g 

H(w',  w'^  y*),  w'^z  =  w'^y  -  w''^y*  =  0.  From  (5.9),  this  implies  that  z  g  F.  Therefore  y  = 

z  +  y*  G  (F  +  {y*})  n  Y.  Hence, 

H(w',w'^y*)nYc(F+{y*})nY.  (5.13) 

By  (5.12)  and  (5.13), 

(F  +  {y*})  n  Y  =  H(w',  w'"^  y*)n  Y. 

From  (5.11),  since  H  (w',  w'"^  y*)  is  a  supporting  hyperplane  of  Y  at  y°  g  Y,  (F  + 
{y*})  n  Y  is  an  exposed  face  of  Y. 

By  definition,  the  dimension  of  (F  +  {y*})  n  Y  is  the  maximum  number  of  linearly 
independent  vectors  in 

{y-y*|yG(F  +  {y*})nY} 
=  {z  I  z  G  F  and  z  +  y*  g  Y} 
cF. 
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Notice  that  F  is  an  /-face  containing  the  origin.  The  maximum  number  of  linearly 
independent  vectors  in  F  is/.  Therefore,  the  dimension  of  (F  +  {y*})  n  Y  is  less  than  or 
equal  to/  On  the  other  hand,  since  F  is  an /-face  of  cone  (Y  -  {y*}),  there  exist /linearly 
independent  vectors  vi,  V2,  ...,  v/in  F.  Since  F  e  cone  (Y-{y*}),  for  each  Vi  (1  <i  <f), 
there  is  a  ki  >  0  such  that 

kiVi  +  y*  e  Y. 
Since  F  is  an  exposed  face  of  cone  (Y  -  {y*})  and,  for  each  1  <  i  </  Vi  is  in  F,  it  follows 
from  (5.7)  that  kiVi  e  F.  Since  Vi,  i  =  1,  2,  .../,  are  linearly  independent  vectors  in  F,  kiVi  + 
y*,  i  =  1,  2,  ...,/  are/linear  independent  vectors  in  (F  +  {y*})  o  Y.  Thus,  the  dimension 
of(F  +  {y*})nY  equals/  ,,    „    ..^ 

(b)  Suppose  that  (F  +  {y*})  n  Y  is  not  a  maximal  exposed  face  of  Y.  Then,  there 
is  a  g-face  G  of  Y  such  that 

(F+{y*})nYcG,  (5.14) 

and/<  g.  Since  G  is  a  g-face  of  Y,  G-{y*}  is  a  g-face  of  Y-{y*}.  Recall  from  the  proof  of 
Theorem  5.2.2  that  F  e  H(w',  0)  for  some  w'  ^  0.  By  (5.14),  this  implies  that  y*  g  G.  So 
G-{y*}  contains  the  origin.  Let  H(a,  b)  be  a  hyperplane  such  that 

Y-{y*}cir(a,b), 

and 

H(a,b)n(Y-{y*})  =  G-{y*} 
Then  H(a,  b)  must  contain  the  origin.  Therefore,  b  =  0  and 

H(a,  0)  n  cone  (Y-{y*})  =  cone  (G-{y*}). 
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It  follows  that  cone  (G-{y*})  is  an  exposed  face  of  cone  (Y-{y*}).  Since  (G-{y*})  is  a  g- 
face,  the  maximum  number  of  linearly  independent  vectors  in  {y  -  y*|  y  g  G}  is  g. 
Therefore,  the  maximum  number  of  linearly  independent  vectors  in  {t(y  -  y*)|  y  g  G,  t  > 
0}  is  also  g.  This  means  that  cone  (G-{y*})  is  of  dimension  g.  Consequently,  cone  (G- 
{y*})isag-faceofcone(Y-{y*}).    •  '  tr 

We  now  prove  F  c  cone  (G-{y*}).  From  (5.14), 

Fn(Y-{y*})eG-{y*}.  (5.15) 

Since  F  is  an  exposed  face  of  cone  (Y-{y*}),  there  exists  a  supporting  hyperplane  H(w',  0) 
of  cone  (Y-{y*})  such  that  (5.9)  holds.  Let  z  g  F,  z  ^  0,  By  (5.9),  we  may  choose  t  >  0,  y 
G  Y  such  that  z  =  t(y-y*).  Then,  z/t  =  y-y*  g  Y-{y*}.  Furthermore,  by  (5.5),  z/t  g  F. 

Hence, 

z/tGFo(Y-{y*}). 
From  (5.15),  this  implies  that  z/t  g  G-(y*}  which,  in  turn,  implies  that  z  g  cone  (G-{y*}). 
Thus, 

Fc  cone(G-{y*}). 
Consequently,  we  have  shown  that  there  is  a^-face  cone  (G-{y*})  of  cone  (Y-{y*})  such 
that  F  c  cone  (G-{y*})  and/<  g.  This  means  that  F  is  not  a  maximal  face  of  cone  (Y- 
(y* }).  By  the  contrapositive,  part  (b)  is  proven.  □ 

From  the  proof  of  part  (b)  of  Theorem  5.2.5,  if  G  is  a  g-face  of  Y  and  y*  g  G, 
then  cone  (G-{y*})  is  a  g-face  of  cone  (Y-{y*}).  If  G  is  also  a  maximal  exposed  face  of 
Y,  then  cone  (G-{y*})  is  also  a  maximal  exposed  face  of  cone  (Y-{y*}).  To  see  this, 
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suppose  to  the  contrary  that  cone  (G-{y*})  is  not  a  maximal  exposed  face  of  cone  (Y- 
{y*}).  Then  by  definition,  there  is  an/-face  F  of  cone  (Y-{y*})  such  that  g  </and 

cone(G-{y*})cF.  (5.16) 

Since  G  is  a  face  of  Y,  we  have  that  G  c  Y.  It  thus  follows  from  (5.16)  that  G  c  (F  + 
{y*})  n  Y.  Since  F  is  an /-face  of  cone  (Y-{y*}),  it  follows  from  Theorem  5.2.5(a)  that 
(F  +  {y*})  o  Y  is  an /-face  of  Y.  Thus,  we  have  shown  that  there  is  an /-face  (F  +  {y*}) 
n  Y  such  that/>  g  and 

Gc(F+{y*})nY. 
This  contradicts  the  fact  that  G  is  a  maximal  exposed  face  of  Y.  Consequently,  cone  (G- 
{y*})  must,  in  fact,  be  a  maximal  exposed  face  of  cone  (Y-{y*}).  We  have  thus  proven 
the  following  result. 

Theorem  5.2.6.  Suppose  that  G  c  R^  and  y*  e  G. 

(a)  If  G  is  ag-face  of  Y,  then  cone  (G-{y*})  is  ag-face  of  cone  (Y-{y*}). 

(b)  If  G  is  a  maximal  exposed  face  of  Y,  then  cone  (G-{y*})  is  a  maximal  exposed 
face  of  cone  (Y-{y*}). 

Theorems  5.2.5  and  5.2.6  establish  a  one-to-one  correspondence  between  the 
exposed  faces  of  Y  containing  the  extreme  point  y*  and  the  exposed  faces  of  cone  (Y- 

{y*})- 

Now,  suppose  that  in  addition  to  being  an  extreme  point  of  Y,  y*  is  an  efficient 
point  of  problem  (MOLPY).  We  want  to  find  all  maximal  efficient  faces  containing  y*  in 
the  outcome  space  Y  of  problem  MOLP  In  order  to  present  the  theorem  for  finding  all 
maximal  efficient  faces  containing  y*,  we  first  derive  two  useful  lemmas.  _,      .^ 
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Lemma  5.2.1.  Let  B,  D  and  F  be  nonempty  convex  sets  in  R*".  Suppose  that  F  is  an 
exposed  face  of  B  and  F  r\D^0.  Then  F  n  D  is  an  exposed  face  of  B  o  D. 

Proof  Since  F  is  an  exposed  face  of  B,  there  exists  a  hyperplane  H(a,  bo)  such  that 
F  =  H(a,  bo)  n  B 
and 

Be  H- (a, bo). 

Therefore,  since  F  f^D^0, 

F  n  D  =  H(a,  bo)  n  (B  n  D) 
and 

0^BoDe  H  (a,bo). 

By  definition,  F  n  D  is  an  exposed  face  of  B  n  D.  D 

Lemma  5.2.2.  Let  B  c  R""  be  a  polyhedral  cone  containing  more  than  just  the 
origin  but  containing  no  lines,  and  let  F  be  an  exposed  face  of  B  containing  more  than  just 
the  orign.  Suppose  that  B  is  generated  by  b',  b  ,  . . .  ,b  ,  i.e., 

B  =  {Xt,b'|t.>0}. 

1=1 

Then,  F  is  generated  by  F  n  {b',  b^  ,.  .,b''}. 

V'   Proof  Since  F  is  an  exposed  face  of  B,  there  exists  a  hyperplane  H(a,  bo)  such  that 
F  =  H(a,  bo)nB,  (5.17) 


and 


BcH-(a,bo).  (5.18) 
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Since  B  is  a  polyhedral  cone  containing  no  lines,  F  is  also  a  polyhedral  cone  containing  no 
lines.  Together  with  the  assumption  that  F  contains  more  than  just  the  origin,  this  imphes, 
by  Corollary  18.5.2  of  Rockafellar  (1970),  that  F  is  generated  by  its  extreme  directions.    : 

Assume  that  d  is  an  extreme  direction  of  F.  Suppose  that  d  is  not  an  extreme 
direction  of  B.  Then  there  exist  d',  d^  e  B  and  0  <  t  <  1  such  that 

d  =  td'  +  (l-t)d'. 
Therefore,  ' ' 

a''d  =  ta''d'  +  (l-t)aV.  (5.19) 

By  (5.18),  a^d'  <  bo  and  aV  <  bo.  Notice  that,  from  (5.17),  a'^d  =  bo.  It  follows  from 
(5.19)  and  0  <  t  <  Ithat  a'^d'  =  aV  =  a'd  =  bo.  By  (5.17),  this  implies  that  d',  d^  g  F. 
Hence,  d  is  not  an  extreme  direction  of  F.  This  contradicts  the  assumption  near  the 
beginning  of  this  paragraph.  Therefore,  d  is  an  extreme  direction  of  B.  This  implies  that 
there  is  an  i  g  {1,  2,  ...,  k}  such  that  d  =  tob'  for  some  to  >  0.  Hence,  F  can  be  generated 
byFn{b',b^...,b''}.  ■■^-  ,  \  „  □ 

Let 

c  ■'-    ._ 

W={wGR''|wi^O,i=l,...,p}, 
and  let  v 

W"={  wGRP|wi>0,  i=l,...,p}. 

Let  y*  be  an  efficient  extreme  point  of  problem  (MOLPY).  By  Proposition  4.2.2, 

W(y*)  is  a  polyhedral  cone.  So,  W(y*)  n  W  is  a  polyhedral  cone  containing  no  lines. 

Furthermore,   by  Theorem  4.2.2,   W(y*)  n  W  contains  more  than  just  the  origin. 

Therefore,  it  follows  from  Corollary  18.5.2  of  Rockafellar  (1970)  that  W(y*)  r^  W  can  be 


128 

generated  by  its  extreme  directions.  Let  (W(y*)  n  W)ed  be  a  set  of  extreme  directions  that 
generate  W(y*)  n  W.  We  have  following  theorem. 

Theorem  5.2.7.  Let  y*  be  an  efficient  extreme  point  for  problem  (MOLP),  and  let 
G  be  a  maximal  efficient  face  of  problem  MOLPY  containing  y*.  Then,  there  exists  at 
least  one  point  w  e  (W(y*)  n  W)ed  such  that 

G  =  {y  G  R"!  wV  =  wV,  y  e  Y}. 
Proof  From  Theorem  2.1  of  Armand  and  Malivert  (1991),  there  is  w"  >  0  such 
that 

G  c  {y  G  Y|  y  optimally  solves  problem  (LP^o )}, 

where  problem  ( LP^„ )  is  given  by 

(LP^o)     maxCwYy,    s.t.  y  g  Y.  .•,, 

Notice  that  {y  g  Y|  y  optimally  solves  problem  (LP^o )}  is  an  efficient  face  of  problem 

(MOLPY).  Since  G  is  a  maximal  efficient  face,  it  follows  that 

G  ==  {y  G  Y|  y  optimally  solves  problem  (LP^„ )}.  (5. 20) 

Since  y*  g  G,  we  have  w°  g  W(y*).  Thus, 

w"  e  W(y*)  n  W.  (5.21) 

Since  G  is  a  maximal  exposed  face  of  Y,  it  follows  from  Theorem  5.2.6  (2)  that  cone  (G- 
{y*})  is  a  maximal  exposed  face  of  cone  (Y-{y*}). 

Let  z  G  cone  (G-{y*}).  Then,  there  is  k  >  0  and  a  point  y  g  G  such  that 

z  =  k  (y-y*). 
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This  implies  that  (w°)^z  =  k((w")^y  -(w*^)^y*).  Since  y,  y*  g  G,  they  both  optimally  solve 
problem  (LP^o  ),  and  (wYy  =  (w°f  y*.  Hence,  (w*')^z  -  0.  This  implies  that  w"  e  {w|  w'^z 

=  0 } ,  where  z  is  an  arbitrary  el  ement  of  cone  (G-  { y  * } ) . 

From  the  previous  paragraph,  w"  e       P|{w|  w'^z  =  0}.  By  (5.21),  this  implies 

z£cone(G-{y*}) 

that 

w°e       fl{weW(y*)|w^z  =  0} 

zecone(G-(y*)) 

=  (cone(G-{Y*}))\  (5.22) 

where   the   equation    follows   from    Theorem    5.2.1.    By   (5.21)    and    (5.22),    w     g 
(cone(G-{Y*}))*n  W.  Notice  that  w"  >  0.  Therefore,    (cone(G-{Y*}))^n  W  is 

nonempty  and  contains  more  than  just  the  origin. 

Since  cone  (G-{y*})  is  an  exposed  face  of  cone  (Y-{y*}),  it  follows  from 
Theorem  5.2.2  that  (cone(G-{Y*}))'^  is  an  exposed  face  of  W(y*).  By  Lemma  5.2.1, 
since  (cone(G-{Y*}))^ni  W  is  nonempty,  it  is  an  exposed  face  of  W(y*)  r\  W.  By 
(5.21),  W(y*)  n  W  is  a  nonempty  polyhedral  cone  containing  more  than  just  the  origin  but 
containing  no  lines.  By  Lemma  5.2.2,  (cone(G-{Y*}))'^n  W  is  generated  by 
[(cone(G-{Y*)))^r^  W]  o  (W(y*)  n  W)ed. 

Choose  w  G  [(cone(G-{Y*}))^r^  W]  r^  (W(y*)  o  W)ed.  Since  w  g 
(cone(G-{Y*}))'',  from  Theorem  5.2. 1  we  see  that  cone  (G-{y*})  c  H(w,  0).  Hence,  G- 
{y*}  c  H(w,  0).  Rewriting  this  inclusion,  we  obtain  that  G  c  {y*}  +  H(w,  0)  =  H(w, 
w^y*).  Since  G  c  Y,  this  implies  that  G  c  Y  n  H(w,  w^y*)  =  {y  g  R''|  w^y  =  w^y*,  y  g 


:i 


130 

Y}.  Notice  that  since  y*  optimally  solves  problem  (LP^„ ),  {y  e  R*"!  w^y  =  w^y*,  y  e  Y} 
is  an  exposed  face  of  Y.  Since  G  is  a  maximal  face  of  Y,  this  imphes  that  G  =  {y  g  R''|  w  y 

=  wV,yeY}.  ...,,./  D 

Remark  5.2.2.  From  Theorem  5.2.7,  we  can  find  all  maximal  efficient  faces  of 
problem  (MOLPY)  containing  y*  in  the  outcome  space  by  properly  choosing  some 
vectors  in  (W(y*)  n  W)ed.  Notice  further  that  G  =  {y  e  R""!  w^y  =  w\*,  y  e  Y}  is  an 
efficient  face  of  problem  (MOLPY)  containing  y*  for  any  w  G((W(y*)  o  W)ed)  r\  W".  So, 
in  order  to  find  all  maximal  efficient  faces  of  problem  (MOLPY)  containing  y*,  we  only 
need  to  verify  the  efficiency  of  each  of  the  faces  of  Y  that  are  determined  by  (y  s  R*"!  w^ 
=  w^y*,  y  e  Y},  where  w  is  an  element  of  (W(y*)  n  W)ed  such  that  w  €  W**. 

We  now  present  a  way  to  verify  the  efficiency  of  each  face  {y  g  R''|  w^y  =  w^y*,  y 
E  Y)  of  problem  (MOLPY),  where  w  g  (W(y*)  r^  W)ed  and  w  g  W**.  First,  consider  the 
following  result. 

Theorem  5.2.8.  Let  y*  be  an  efficient  extreme  point  for  problem  (MOLPY),  and 
let  w*  be  an  element  of  (W(y*)  n  W)ed  such  that  w*  g  W".  Then,  the  set  S(w*,  y*)  =  {y 
G  R''|  w*^y  -  w*^y*,  y  g  Y}  is  an  efficient  face  of  problem  (MOLPY)  if  and  only  if  the 
multiple  objective  linear  programming  problem 

P(w*,  y*):  v-max  y,  s.t.  y  g  S(w*,  y*) 
is  completely  efficient,  i.e.,  each  point  in  S(w*,  y*)  is  an  efficient  point  of  problem  P(w*, 

y*). 

Proof  Suppose  that  S(w*,  y*)  is  an  efficient  face  of  problem  (MOLPY).  Let  y'  be 
an  arbitrary  point  in  S(w*,  y*).  Then  y'  is  an  efficient  point  of  problem  (MOLPY). 
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Therefore,  there  is  no  y  in  Y  such  that  y  >  y'  and  y  ;i  y'.  Hence,  there  is  no  y  in  S(w*,  y*) 
e  Y  such  that  y  >  y'  and  y  ;^  y'.  This  implies  that  y'  is  an  efficient  point  of  problem  P(w*, 
..-    y*).  Therefore,  problem  P(w*,  y*)  has  complete  efficiency  when  S(w*,  y*)  is  an  efficient 
;.   face  of  problem  (MOLPY). 

Now,  suppose  that  problem  P(w*,  y*)  has  complete  efficiency.  Assume  that  there 
is  a  point  y  in  S(w*,  y*)  such  that  y  is  not  an  efficient  point  of  problem  (MOLPY).  By 
definition,  there  is  a  point  y*^  in  Y  such  that 

y°>y  andyVy.  "'\^         (5.23) 

Since  w*  e  W,  w*  >  0.  From  (5.23),  this  implies  that 

w*y  >w*^y  =w*V,  '  (5-24) 

where  the  equation  follows  from  y  e  S(w*,  y*).  Recall  that  w*  g  W(y*),  where         i^ 

W(y*)  =  (  w  e  R^l  w'^y*  >  w^  for  all  y  in  Y} . 
This  implies  that        ,  ,         ■*. 

,        .w*V>w*V.  (5.25) 

From  (5,24)  and  (5.25),  w*V  =  w*'^y*.  Therefore,  y°  g  S(w*,  y*).  From  (5.23),  this 
implies  that  y  is  not  an  efficient  point  of  problem  P(w*,  y*),  which  contradicts  the 
assumption  that  problem  P(w*,  y*)  has  complete  efficiency.  Hence,  each  point  in  S(w*, 
y*)  is  an  efficient  point  of  problem  (MOLPY).  Since  y*  is  an  efficient  extreme  point  for 
problem  (MOLPY)  and  w*  g  W(y*),  we  have  w*\  <  w*^y*  for  each  y  in  Y.  So  Y  c 
H"(w*,  w*^  y*)=  (y  g  R^I  w*'^y  <  w*''y*}.  It  follows  that  H(w*,w*^  y*)=  {y  g  R^I 
w*^y  =  w*^y*}  is  a  supporting  hyperplane  of  Y  at  y*.  Therefore,  S(w*,  y*)  =  (y  g  R*"! 
w*^y  =  w*^y*,  y  G  Y}  =  Y  n  H(w*,  w  *^  y*)  is  an  exposed  face  of  Y  Consequently, 
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S(w*,  y*)  is  an  efficient  face  of  problem  (MOLPY)  when  problem  P(w*,  y*)  is  completely 

efficient.  0 

Notice  that  problem  P(w*,  y*)  has  complete  efficiency  if  and  only  if  the  following 

problem  P'(w*,  y*)  has  complete  efficiency,  where  problem  P'(w*,  y*)  is  defined  as 

follows: 

P'(w*,  y*):    v-max  Cx  .  * 

s.t.  w*^Cx  =  w*^y*, 
Ax  <  b,  X  >  0. 

From  Theorem  2  of  Benson  (1991),  problem  P'(w*,  y*)  has  complete  efficiency  if  and 

only  if  the  following  linear  programming  problem  LP(w*,  y*)  has  optimal  solutions  and 

the  optimal  value  equals  zero,  where  LP(w*,  y*)  is  given  by 

LP(w*,  y*);  min  <b,  q>  +  9  <w*,  y*> 
s.t.  q^A  +  ew*^C  -  z/  >  0, 
q^-ZM^>0,  _ 
-u^C  +  r'A  +  e  w*'^C  -  z/ =  e^C,  "      ,- 

^•.■^  U,  Zn,  Zm>0,  ■  '  "::  -. 

where  q  g  R",  zn  e  R",  zm  e  R",  u  g  K\  r  g  R"",  9  g  R  and  B   g  R  are  variables 
Consequently,  we  have  the  following  result.  ,  " . 

Theorem  5.2.9.  Let  y*  be  an  efficient  extreme  point  for  problem  (MOLPY),  let  w* 
be  an  element  of  (W(y*)  n  W)ed  such  that  w*  €  W.  Then,  the  set  S(w*,  y*)  =  (y  g  R"]        ■' 
w*^y  =  w*^y*,  y  G  Y}  is  an  efficient  face  of  problem  (MOLPY)  if  and  only  if  the  linear 
programming  problem  LP(w*,  y*)  has  at  least  one  optimal  solution  and  the  optimal  value 
equals  zero. 
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5.3.  The  Algorithm  for  Finding  the  Efficient  Outcome  Set 

t  ■  .■■    \    ■   .J' 
In  Chapter  4,  we  presented  two  algorithms  for  finding  the  set  of  all  efficient 

extreme  points  of  problem  MOLP  in  the  outcome  space.  It  is  possible,  in  theory,  to  find  all 

of  Ye  by  first  using  one  of  these  algorithms  to  find  Ye  n  Yex.  Then,  based  on  Theorems    :. 

5.2.7  and  5.2.9  and  Remark  5.2.2,  one  could  find  the  entire  efficient  outcome  set  as 

follows.  For  each  efficient  extreme  point  y*  found  in  the  outcome  space,  one  could  find  all 

of  the  efficient  faces  given  by  {y  e  R''|  w\  =  w^y*,  y  g  Y}  for  some  w  G(W(y*)  n  W)ed. 

Then,  if  we  want  to  find  an  explicit  representation  of  (y  g  R''|  w  y  =  w  y*,  y  e 
Y},  we  could  find  all  extreme  points  of  {y  g  R*"!  w^y  =  w^*,  y  g  Y}.  i 

The  approach  to  be  proposed  here,  however,  does  not  need  to  first  find  all  of  Ye  n 
Yex  by  using  the  algorithms  in  Chapter  4  or  any  other  algorithms.  Instead,  it  finds  all  of  Ye 
n  Yex  as  a  byproduct  of  the  procedures  it  uses  to  find  each  maximal  efficient  face  of 
problem  (MOLPY).  The  idea  of  this  approach  is  as  follows.  In  the  first  iteration,  the 
algorithm  finds  an  initial  efficient  extreme  point  y'  of  Y.  Then,  by  using  Theorems  5.2.7 
and  5.2.9,  it  generates  all  maximal  efficient  faces  containing  y'  and  finds  all  of  the  extreme 
points  of  these  faces.  At  each  of  the  following  iterations,  the  algorithm  first  finds  a  new 
efficient  extreme  point  such  that  there  is  at  least  one  efficient  face  containing  this  point 
that  has  not  yet  been  found.  Then,  using  Theorems  5.2.7  and  5.2.9,  it  generates  all 
unexplored  maximal  efficient  faces  containing  the  current  efficient  extreme  point  and  all 
extreme  points  of  these  faces.  The  process  continues  in  this  way  until  all  maximal  efficient 
faces  and  all  efficient  extreme  points  have  been  found. 

To  give  the  details  of  this  approach,  first  let 
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F  =  the  set  of  all  efficient  faces  of  Y  that  have  been  found  at  any  point  in  the 
algorithm, 
EY  =  the  set  of  all  extreme  points  of  the  efficient  faces  in  F  that  have  been 

found  at  any  point  in  the  algorithm, 
EY'  =  the  set  of  all  efficient  extreme  points  found  at  any  point  of  the  algorithm 
for  which  all  efficient  faces  containing  these  points  have  been  explored, 
and 
D"  -  the  union  of  (W(y)  r^  W)ed  over  all  y  in  BY'. 
An  outline  of  the  algorithm  is  as  follows. 
STEP  1 .     Find  an  initial  efficient  extreme  point  y'.  Set  k  :=  1,  F  =  EY  -  EY'  =  D"  =  0. 
STEP  2.     For  y',  calculate  (WCy')  r^  W)ed.  If  (WCy')  n  W)ed  \  D"  =  0,  set  EY'  =  EY'  u 
(y'^jand  go  to  STEP  3.  Otherwise,  suppose  that 

.    .        (W(y')nW)ed\D"={w'^w''\...,w'-'')- 
For  each  i  g  { 1,  2,  ...,  ik},  let  Fi,k  be  the  face  of  Y  determined  by  w'"'',  i.e., 

Fi,k  =  {y  =  Cx|  {W'^yCx  =  (W^)y,  Ax  ^  b,  X  >  0}. 
For  each  i  e  {1,  2,  ...,  ik},  the  set  of  all  extreme  points  of  Fi,k  is  denoted  by 
EY''"'.  Now,  for  each  i  g  {1,  2,  ...,  ik},  check  whether  Fi,kis  an  efficient  face  of 
problem  (MOLPY)  or  not.  For  each  is  {1,  2,  ...,  ik},  if  Fi,k  is  an  efficient  face 
of  problem  (MOLPY),  find  EY'-'^  and  set  F  =  F  u  {Fjj,}  and  EY  =  EY  l^  EY^'^. 
Set  EY'  =  EY'  u  (y'^ } ,  D"  =  D"  ^  (W(y'')  r^  W)ed,  and  k  =  k+ 1 . 
STEP  3.     If  EY  \  EY'  -  0,  stop:  Ye  =  \JV,  and  Ye  nYex  =  EY.  Otherwise,  choose  y''  e 

EY  \  EY'.  Go  to  STEP  2. 
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Let  w  >  0  be  a  given  vector  in  R''.  Since  Y  is  compact,  the  problem  of  maximizing 
w^y  over  Y  has  at  least  one  extreme  point  optimal  solution.  It  follows  that  problem  MOLP 
has  at  least  one  efficient  extreme  point  in  outcome  space.  So,  we  can  always  find  an  initial 
efficient  extreme  point  y'  in  STEP  1.  Thus,  STEP  1  is  well  defined. 

It  is  obvious  that  STEP  2  and  STEP  3  are  also  well  defined. 

Theorem  5.3.1.  The  algorithm  is  finite  and  always  generates  the  sets  Ye  and  Ye  o 

Yex. 

Proof  The  algorithm  stops  when  EY  \  EY'  =  0.  From  STEP  2,  we  know  that,  at 
each  iteration  k,  EY  :=  EY  o  EY^,  where  EY°  =  u{EY''''|  Fi,k  is  an  efficient  face  of 
problem  MOLP,  i  =  1,  2,  ...,  ik}.  Notice  from  Remark  5.2.2  that  all  maximal  efficient  faces 
containing  /  are  in  the  set  of  {Fi,k  |  i  =  1,  2,  ...,  ik}.  Furthermore,  if  Fi,k,  i  g  {1,  2,  ...,  ik}  is 
an  efficient  face  of  problem  MOLP,  it  follows  from  Theorem  4.3.2  that  EY'"'  is  a  subset  of 
Ye  n  Yex  •  So,  EY"  is  the  set  all  extreme  points  of  all  efficient  faces  containing  the  current 
efficient  extreme  point  y'',  which  is  a  subset  of  Ye  n  Yex  So,  EY  is  also  a  subset  of  Ye  r^ 
Yex.  On  the  other  hand,  we  know  fi-om  STEP  2  that  at  each  iteration  a  point  fi-om  Ye  n 
Yex  is  added  to  EY".  So,  EY  \  EY'  will  be  an  empty  set  after  a  finite  number  of  iterations. 

From  the  above  discussion,  we  also  know  that  the  algorithm  finds  all  maximal 
efficient  faces  containing  the  efficient  extreme  point  y''  given  at  STEP  2  of  iteration  k.  So, 
we  only  need  to  prove  that  the  algorithm  always  finds  Ye  n  Yex  to  complete  the  proof 

Suppose  that  the  algorithm  stops  at  iteration  k  and  Ye  r\  Yex  ^  EY.  Then,  there 
exist  y*  G  Ye  n  Yex  and  y*  ^EY.  From  Zeleny  (1974)  and  Yu  and  Zeleny  (1975),  y*  and 
y''  are  connected  to  one  another  by  a  series  of  adjacent  efficient  extreme  points  in  Ye  n 
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Yex.  Suppose  that  y\  y""^',...,  y""',  y'""'",..,  y*  is  such  a  series  of  adjacent  efficient 
extreme  points  connecting  y''  to  y*.  Since  y''  sEY,  all  maximal  efficient  faces  containing  / 
must  have  been  found.  As  a  result,  all  efficient  extreme  points  adjacent  to  y*"  must  have 
also  been  found.  Since  y*'  and  y""^'  are  adjacent  to  one  another,  y''^'  must  have  been  found. 
Thus,  /^'  e  EY.  Since  /"^^  gEY,  all  efficient  extreme  points  adjacent  to  y""^^  must  have 
been  found.  Thus,  the  adjacent  efficient  extreme  point  y'''^^  of  y"""^'  must  have  been  found. 
Therefore,  y"""^^  eEY.  Repeating  this  process,  we  have  that  y*  eEY.  This  contradicts  the 
assumption  that  y*  gEY.  So,  Ye  n  Yex  =  EY  when  the  algorithm  stops.  .      D 

Now,  we  address  the  issue  of  how  to  implement  the  algorithm. 

In  STEP  1,  we  need  to  find  an  initial  efficient  extreme  point  y'  of  Y.  This  can  be 
done  by  solving  problem  LP(w)  for  any  given  w  >  0  and  then  using  Subprocedure  I  of 
Section  4.3. 

In  STEP  2,  we  need  to  find  all  extreme  directions  of  the  cone  W(y'')  n  W.  We 
explain  now  one  method  for  accomplishing  this. 

From  (4.25),  w  e  W(y'')  if  and  only  if  there  exist  a  vector  u''  >  0  and  a  vector  v''  > 
0  such  that 

C'^w  -(A'')^u''  +  (E")  V  =  0, 
where  A*'  and  E*'  are  two  matrices  related  to  y''  that  can  be  easily  found.  Therefore, 

W(/)  n  W 
=  {weW|  CV  -(A'')V  +  (E') V  =  0,  u''  >  0,  /  >  0} . 
Notice  that  w  is  an  extreme  direction  of  cone  WCy"^)  o  W  if  and  only  if  w/||w||  is  an 
extreme  point  of  W(y'')  n  W  r^  {w|  e^w  <  1}  adjacent  to  the  origin.  We  can  use  the 
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algorithm  in  Benson  and  Sun  (2000)  to  find  all  extreme  points  of  W(y'')  n  W  r^  {w|  eV  < 
1 } adjacent  to  the  origin. 

In  STEP  2,  we  need  to  check  whether  or  not  each  face  Fi,k,  i  =  1,  2,  ..,  ik  is 
efficient.  Notice  that  Fi,k  =  S(w'^  y'').  From  Remark  5.2.2,  if  w'-''  >  0,  where  i  e  {1,  2,  ..., 
ik},  then  the  corresponding  face  Fi,k  is  an  efficient  face.  If  w"'"'  ^  W**,  from  Theorem  5.2.9 
Fi,k  =  S(w'''',  y'')  is  an  efficient  face  of  problem  (MOLPY)  if  and  only  if  the  linear 
programming  problem  LP(w'''',  y'')  has  at  least  one  optimal  solution  and  its  optimal  value 
equals  zero.  Hence,  when  w'''  g  W**,  we  can  test  for  the  efficiency  of  face  Fi,k  by  solving 
the  linear  programming  problem  LP(w'''',  y'')  and  checking  whether  or  not  its  optimal  value 
equals  zero. 

In  STEP  2,  we  also  need  to  find  all  extreme  points  of  the  face  Fi,k  ==  {y=Cx| 
(w'''')^Cx  =  (w'''')V.  Ax  <  b,  X  >  0}  if  it  is  an  efficient  face  of  problem  MOLP  in  the 
outcome  space.  Let  X'  =  {x  g  R"1  (w'-^Cx  =  (w'''')V,  Ax  <  b,  x  >  0}.  Thus,  we  need  to 
find  all  extreme  points  of  the  outcome  polytope  CX'  of  X'.  We  present  two  possible  ways 
for  accomplishing  this. 

One  way  for  finding  all  extreme  points  of  CX'  is  based  upon  the  algorithm  of 
Benson  and  Sun  (2000).  To  describe  the  procedure,  we  say  an  extreme  point  of  CX'  is 
explored  if  all  extreme  points  adjacent  to  it  have  been  found  by  using  the  algorithm  in 
Benson  and  Sun  (2000).  Otherwise,  it  is  called  unexplored. 

The  procedure  is  as  follows.  First,  an  initial  extreme  point  of  CX'  is  found.  Then, 
all  extreme  points  of  CX  adjacent  to  the  initial  extreme  point  are  found  by  using  the 
algorithm  in  Benson  and  Sun  (2000).  In  each  of  the  following  iterations,  we  first  choose 
an  unexplored  extreme  point  from  the  extreme  points  that  have  been  found.  Then,  we  find 
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all  extreme  points  of  CX'  adjacent  to  the  chosen  extreme  point.  This  process  goes  on  until 
all  extreme  points  have  been  found  and  explored. 

The  other  way  to  find  all  extreme  points  of  CX'  is  as  follows.  First,  we  construct 
an  algebraic  description  of  CX'  in  the  outcome  space  R''  by  using  an  algorithm  in  Dauer 
and  Saleh  (1990).  With  a  known  algebraic  description  of  CX',  there  are  many  algorithms 
available  for  finding  all  extreme  points  of  CX'.  For  a  survey  of  these  kinds  of  algorithms 
we  refer  to  Matheiss  and  Rubin  (1983). 


**  ^  5.4.  Concluding  Remarks 

From  the  literature,  we  know  that  the  algorithms  in  Benson  (1998a  and  1998c)  can 
generate  the  entire  weakly  efficient  outcome  set  in  the  outcome  space.  However,  the  work 
of  generating  the  entire  efficient  outcome  set  from  the  weakly  efficient  set  is  generally 
nontrivial.  To  our  knowledge,  there  are  no  direct  algorithms  for  finding  the  entire  efficient 
outcome  set.  In  this  chapter,  we  have  therefore  presented  and  validated  the  first  algorithm 
that  is  capable  of  generating  the  entire  efficient  outcome  set  directly. 

The  algorithm  is  finite.  It  works  in  the  outcome  space  and  can  be  implemented  by 
using  linear  programming  techniques. 
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CHAPTER  6 
SUMMARY  AND  FUTURE  RESEARCH 

In  this  dissertation,  we  liave  investigated  the  closedness  of  the  efficient  set  for 
problem  (MOMP)  in  Chapter  3.  We  then  presented  an  algorithm  for  finding  the  set  of  all 
efficient  extreme  points  in  the  outcome  space  for  problem  (MOLP)  in  Chapter  4.  Finally, 
in  Chapter  5,  we  presented  an  algorithm  for  finding  the  entire  efficient  points  in  the 
outcome  space  for  problem  (MOLP).  In  this  chapter,  we  summarize  our  work  and  briefly 
discuss  some  potential  future  research  topics. 

As  we  mentioned  in  Chapter  3,  there  are  various  theoretical,  algorithmic,  and 
practical  reasons  for  developing  necessary  and  sufficient  conditions  for  the  efficient  set  of 
a  multiple  objective  mathematical  programming  problem  (MOMP)  to  be  closed.  Yet  only 
a  small  number  of  results  of  this  type,  limited  to  special  cases  of  problem  (MOMP),  such 
as  the  linear  case  and  the  bicriteria  case,  have  been  developed.  This  leaves  open  the 
question  of  whether  there  exist  classes  of  vector-valued,  nonlinear  fiinctions  for  which  it  is 
guaranteed  that  E(f,  X)  is  closed. 

In  Chapter  3,  we  answered  the  question  posed  above,  and  several  other  questions 
concerning  the  closedness  of  E(f,  X).  Our  approach  relied  in  part  upon  generalizing  the 
concepts  of  quasiconcavity  and  strict  quasiconcavity  for  real-valued  functions  to  vector- 
valued  functions.  Our  approach  also  relied  upon  some  new  characterizations  of  an  efficient 
solution  for  problem  (P)  that  we  developed  in  Chapter  3.  From  Theorem  3.4.3,  we  know 
that  when  the  feasible  set  X  c  R"  is  a  nonempty,  compact  convex  set,  and  the 
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vector-valued  function  f  =  (fi,...,fp)^  is  continuous  and  strictly  quasiconcave  on  X,  the 
efficient  set  E(f,  X)  is  closed.  This  leaves  open  at  least  two  issues.  One  is  the  issue  of 
finding,  if  possible,  necessary  conditions  and  sufficient  conditions  for  a  vector-valued 
function  to  be  strictly  quasiconcave.  The  other  is  the  issue  of  finding  relationships  between 
strictly  quasiconcave  vector-valued  functions  and  other  classes  of  functions.  In  Chapter  3, 
we  have  presented  some  properties  of  quasiconcave  vector-valued  functions  and  strictly 
quasiconcave  vector-valued  functions,  and  some  relationships  between  quasiconcave 
vector-valued  functions  and  strictly  quasiconcave  vector-valued  functions  and  some  other 
classes  of  Sanctions  (see  Theorems  3.2.1-3.2.4  and  Figure  3.1).  However,  we  would  like 
to  identify  more  properties  and  more  relationships  to  fiilly  understand  the  new  concepts  of 
quasiconcave  vector-valued  Sanctions  and  strictly  quasiconcave  vector-valued  fianctions 
that  we  proposed  in  Chapter  3. 

If  we  replace  the  vector-valued  function  f(x)  and  the  feasible  set  X  with  f(x,  u)  and 
X(u)  in  problem  (MOMP),  where  u  is  a  parametric  vector  in  R",  then  the  efficient  set  F(u) 
=  E(f(x,  u),  X(u))  of  problem  (MOMP)  changes  with  u.  One  of  the  important  research 
areas  in  multiple  objective  mathematical  programming  is  the  investigation  of  the  stability 
of  the  efficient  set  F(u),  i.e.  to  investigate  the  upper  and  lower  semicontinuty  of  the  point- 
to-set  mapping  u^F(u)  (see  Tanino  and  Sawaragi  (1980),  Naccache  (1979)  Jurkiewicz 
(1983)  and  Sawaragi  et  al.  (1985)).  However,  only  limited  results  concerning  the  upper 
semicontinuty  of  the  point-to-set  mapping  u->F(u)  appear  in  the  literature  (see  Sawaragi 
et  al.  (1985)  for  example).  In  the  fiature,  we  would  like  to  investigate  the  stability  of  the 
efficient  set  F(u)  for  problem  (MOMP)  when  the  vector-valued  objective  fianction  of 
problem  (MOMP)  is  quasiconcave  or  strictly  quasiconcave. 
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As  we  mentioned  in  Chapter  4,  various  kinds  of  algorithms  have  been  developed 
for  finding  the  set  of  all  efficient  extreme  points  Xe  o  Xex  of  a  multiple  objective  linear 
programming  problem  (MOLP)  in  decision  space.  Although  these  algorithms  are  quite 
different  in  certain  ways,  they  all  utilize  some  modified  version  of  the  simplex  method.    * 
Because  of  the  complexity  of  these  algorithms  and  the  sheer  size  of  the  set  Xe  o  Xex,     -^ 
these  algorithms  have  achieved  only  limited  success  in  practice.  Furthermore,  approaches 
for  generating  the  set  of  efficient  extreme  points  Xe  n  X^x  of  problem  (MOLP)  that  are 
based  upon  decision  space-based  decompositions  of  the  weight  set  W^  also  suffer  fi-om    "■ 
one  of  two  special  drawbacks.  Either  the  required  computations  are  redundant,  or  not  all 
of  the  efficient  extreme  point  set  Xe  n  Xex  is  found.  Both  of  these  drawbacks  are  caused 
by  the  fact  that  decision  space-based  decompositions  of  W°  do  not  guarantee  a  one-to-one 
correspondence  between  the  elements  in  Xe  n  Xex  and  the  elements  in  the  decompositions 
ofW°. 

Recently,  some  researchers  have  begun  to  develop  tools  for  generating  the  set  of 
all  efficient  extreme  points  in  the  outcome  space,  rather  than  in  the  decision  space,  of 
problem  (MOLP).  Since  the  dimension  of  the  outcome  set  Y  is  generally  much  smaller 
than  the  dimension  of  decision  set  X,  the  outcome  set  Y  generally  has  far  fewer  faces  and 
extreme  points  than  the  decision  set.  Thus  solving  problem  (MOLP)  in  the  outcome  space 
rather  than  in  the  decision  space  has  several  practical  advantages. 

In  Chapter  4,  we  presented  a  new  outcome  space-based  decomposition  of  the 
weight  set  W**.  We  proved  that  this  decomposition  establishes  a  one-to-one 
correspondence  between  the  efficient  extreme  points  in  the  outcome  set  Y  and  the 
elements  of  the  decomposition  of  W^.  Thus,  algorithms  based  on  this  decomposition  will      ^ 
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not  face  the  drawbacks  that  are  encountered  by  algorithms  based  on  decision  space-based 
decompositions. 

Based  on  our  outcome  space-based  decomposition  of  the  weight  set  W^,  we 
developed  a  new  class  of  outcome  space-based  decomposition  algorithms,  BWSDA,  for 
finding  the  set  of  all  efficient  extreme  points  in  the  outcome  set  of  problem  (MOLP). 
Based  upon  two  different  kinds  of  implementations  of  one  of  the  key  steps  of  algorithm 
BWSDA,  we  obtained  two  versions  of  algorithm  BWSDA,  called  algorithm  WSDA-I  and 
algorithm  WSDA-II.  These  two  algorithms  are  finite  and  exact.  They  both  work  in  the 
outcome  space.  As  a  result,  they  have  some  potential  advantages  over  decision  space- 
based  algorithms.  Algorithm  WSDA-I  uses  linear  programming  methods,  and  algorithm 
WSDA-II  uses  linear  programming  and  concave  minimization  methods.  They  both  may 
have  the  potential  to  solve  large-scale  multiple  objective  linear  programs  Their  ability  to 
do  so  remains  a  topic  for  fiirther  research. 

In  Chapter  5,  we  presented  an  algorithm  for  finding  the  entire  efficient  outcome  set 
of  problem  (MOLP).  The  rationale  for  generating  the  set  of  all  efficient  points  for  problem 
(MOLP)  in  the  outcome  space  is  that  none  of  the  efficient  extreme  points  in  the  outcome 
space  may  be  an  acceptable  approximation  of  a  most  preferred  solution  of  the  DM  in 
outcome  space.  As  a  result,  we  may  need  to  generate  the  entire  efficient  set.  The 
algorithm  works  in  the  following  way.  In  the  first  iteration,  the  algorithm  finds  an  initial 
efficient  extreme  point  y'  of  Y.  Then,  by  using  Theorems  5.2.7  and  5.2.9,  it  generates  all 
maximal  efficient  faces  containing  y'  and  finds  all  of  the  extreme  points  of  these  faces.  At 
each  of  the  following  iterations,  the  algorithm  first  finds  a  new  efficient  extreme  point  such 
that  there  is  at  least  one  efficient  face  containing  this  point  that  has  not  yet  been  found. 
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Then,  using  Theorems  5.2.7  and  5.2.9,  the  algorithm  generates  all  unexplored  maximal 
efficient  faces  containing  the  current  efficient  extreme  point  and  all  extreme  points  of  these 
faces.  The  process  continues  in  this  way  until  all  maximal  efficient  faces  and  all  efficient 
extreme  points  in  the  outcome  space  have  been  found. 

The  algorithm  can  be  implemented  by  using  linear  programming  techniques.  The 
most  time-consuming  part  at  a  typical  iteration  k  of  the  algorithm  is  to  find  all  extreme 
points  in  the  outcome  space  of  each  efficient  face  Fi,k  =  {y  g  R""!  y  =  Cx,  (w'''')^Cx  = 
(w'''')y,  Ax  <  b,  X  >  0},  i  e  {1,  2,  ...,  ik},  where  ik  is  determined  by  the  algorithm.  We 
suggested  that  this  could  be  implemented  by  using  the  algorithm  in  Benson  and  Sun 
(2000).  Since  the  algorithm  in  Benson  and  Sun  (2000)  may  not  be  an  efficient  way  for 
finding  all  extreme  points  of  F,,k,  one  future  research  topic  would  be  to  find  more  efficient 
methodsfor  generating  all  extreme  points  of  Fi,k.  .' 

As  we  mentioned  earlier,  one  reason  for  solving  problem  (MOLP)  in  the  outcome 
space  rather  than  in  the  decision  space  is  that  the  efficient  outcome  set  is  probably  much 
"smaller"  than  the  efficient  decision  set.  However,  for  large-scale  problems  (MOLP),  the 
size  of  the  efficient  outcome  set  may  still  make  it  difficult  for  a  decision  maker  to  find  a 
final  most  preferred  solution  To  overcome  this  problem,  we  might  consider  using  ideas 
fi-om  interactive  approaches  that  have  been  proposed  for  solving  large-scale  multiple 
objective  linear  programming  problems.  However,  such  interactive  approaches  may  have 
some  disadvantages  (see  Section  2.3).  Thus,  the  best  way  to  solve  large-scale  cases  of 
problem  (MOLP)  might  be  to  use  an  approach  that  combines  the  interactive  approach  and 
the  vector  maximization  approach.  Therefore,  one  potentially-valuable  fijture  research 
topic  would  be  to  develop  algorithms  that  use  the  above  combined  approach. 
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